Jul 14 21:05:31 devstack cinder-volume[76997]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 14 21:05:31 devstack cinder-volume[76997]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 14 21:05:31 devstack cinder-volume[76997]: we strongly recommend against using it for new projects. Jul 14 21:05:31 devstack cinder-volume[76997]: If you are already using Eventlet, we recommend migrating to a different Jul 14 21:05:31 devstack cinder-volume[76997]: framework. For more detail see Jul 14 21:05:31 devstack cinder-volume[76997]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 14 21:05:31 devstack cinder-volume[76997]: import eventlet # noqa Jul 14 21:05:34 devstack cinder-volume[76997]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 21:05:34 devstack cinder-volume[76997]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 21:05:34 devstack cinder-volume[76997]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 21:05:35 devstack cinder-volume[76997]: INFO dbcounter [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Registered counter for database cinder Jul 14 21:05:35 devstack cinder-volume[76997]: DEBUG oslo_db.sqlalchemy.engines [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76997) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 21:05:35 devstack cinder-volume[76997]: DEBUG dbcounter [-] [76997] Writer thread running {{(pid=76997) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 21:05:35 devstack cinder-volume[76997]: INFO cinder.rpc [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 14 21:05:35 devstack cinder-volume[76997]: INFO cinder.rpc [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 14 21:05:35 devstack cinder-volume[76997]: DEBUG oslo_db.sqlalchemy.engines [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76997) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 21:05:35 devstack cinder-volume[76997]: INFO cinder.volume.manager [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Determined volume DB was empty at startup. Jul 14 21:05:35 devstack cinder-volume[76997]: DEBUG cinder.volume.manager [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76997) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 14 21:05:35 devstack cinder-volume[76997]: INFO cinder.volume.manager [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 14 21:05:35 devstack cinder-volume[76997]: WARNING stevedore.named [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 14 21:05:35 devstack cinder-volume[76997]: WARNING castellan.key_manager [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 21:05:35 devstack cinder-volume[76997]: WARNING cinder.keymgr.conf_key_mgr [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 21:05:35 devstack cinder-volume[76997]: DEBUG cinder.volume.drivers.lvm [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76997) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_concurrency.processutils [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76997) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_concurrency.processutils [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] CMD "cinder-rtstool verify" returned: 0 in 0.380s {{(pid=76997) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_db.sqlalchemy.engines [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76997) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 21:05:36 devstack cinder-volume[76997]: INFO cinder.rpc [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 14 21:05:36 devstack cinder-volume[76997]: INFO cinder.rpc [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 14 21:05:36 devstack cinder-volume[76997]: WARNING stevedore.named [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 14 21:05:36 devstack cinder-volume[76997]: WARNING castellan.key_manager [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 21:05:36 devstack cinder-volume[76997]: INFO cinder.volume.manager [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_db.sqlalchemy.engines [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76997) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 21:05:36 devstack cinder-volume[76997]: INFO oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Starting 1 workers Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Started child 77149 {{(pid=76997) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Full set of CONF: {{(pid=76997) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] ******************************************************************************** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Configuration options gathered from: {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] ================================================================================ {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] allow_availability_zone_fallback = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] allow_compression_on_image_upload = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] allowed_direct_url_schemes = [] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] api_rate_limit = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] auth_strategy = keystone {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] az_cache_duration = 3600 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_availability_zone = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_host = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_name = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_stats_polling_interval = 60 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backup_api_class = cinder.backup.api.API {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backup_name_template = backup-%s {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backup_use_same_host = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backup_use_temp_snapshot = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] chap_password = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] chap_username = {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cinder_internal_tenant_project_id = 874d6367a65f4c0790462050b2a6ca38 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cinder_internal_tenant_user_id = d08f2bc499524f11884695337bc27d57 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cloned_volume_same_az = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cluster = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] compression_format = gzip {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[77149]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] compute_api_class = cinder.compute.nova.API {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] config_dir = [] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] config_source = [] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] control_exchange = openstack {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] debug = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] default_availability_zone = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] default_group_type = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] default_volume_type = lvmdriver-1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] disk_geometry = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] driver_client_cert = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] driver_client_cert_key = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] driver_data_namespace = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] driver_ssl_cert_path = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] driver_ssl_cert_verify = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] driver_use_ssl = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] enable_force_upload = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] enable_new_services = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] enable_unsupported_driver = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] enabled_backends = ['lvmdriver-1'] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] enforce_multipath_for_image_xfer = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] filter_function = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance_api_insecure = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance_api_servers = ['http://192.168.122.99/image'] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance_api_ssl_compression = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance_ca_certificates_file = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance_catalog_info = image:glance:publicURL {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance_certfile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance_keyfile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance_num_retries = 3 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance_request_timeout = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] goodness_function = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] graceful_shutdown_timeout = 5 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] group_api_class = cinder.group.api.API {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] host = devstack {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] image_compress_on_upload = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] image_conversion_address_space_limit = 1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] image_conversion_cpu_limit = 60 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] image_conversion_disable = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] image_upload_use_cinder_backend = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] image_upload_use_internal_tenant = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] image_volume_cache_enabled = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] image_volume_cache_max_count = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] image_volume_cache_max_size_gb = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] init_host_max_objects_retrieval = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] instance_format = [instance: %(uuid)s] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] iscsi_target_flags = {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] iscsi_write_cache = on {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] iser_helper = tgtadm {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] iser_ip_address = 192.168.122.99 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] iser_port = 3260 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] log_color = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] log_config_append = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] log_dir = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] log_file = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] log_options = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] log_rotate_interval = 1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] log_rotate_interval_type = days {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] log_rotation_type = none {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] max_age = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] max_logfile_count = 30 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] max_logfile_size_mb = 200 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] max_over_subscription_ratio = 20.0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] message_reap_interval = 86400 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] message_ttl = 2592000 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] migration_create_volume_timeout_secs = 300 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] monkey_patch = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] monkey_patch_modules = [] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] my_ip = 192.168.122.99 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] no_snapshot_gb_quota = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] num_iser_scan_tries = 3 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] num_shell_tries = 3 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] num_volume_device_scan_tries = 3 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] nvmeof_conn_info_version = 1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] nvmet_ns_id = 10 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] nvmet_port_id = 1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] osapi_max_limit = 1000 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] osapi_volume_ext_list = [] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] osapi_volume_listen = 0.0.0.0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] osapi_volume_listen_port = 8776 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] osapi_volume_use_ssl = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] osapi_volume_workers = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] per_volume_size_limit = -1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] periodic_fuzzy_delay = 60 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] periodic_interval = 60 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] project_id_regex = [0-9a-f\-]+ {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] public_endpoint = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] publish_errors = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] quota_backup_gigabytes = 1000 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] quota_backups = 10 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] quota_gigabytes = 1000 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] quota_groups = 10 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] quota_snapshots = 10 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] quota_volumes = 10 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] rate_limit_burst = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] rate_limit_except_level = CRITICAL {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] rate_limit_interval = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] reinit_driver_count = 3 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] replication_device = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] report_discard_supported = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] report_interval = 120 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] reservation_clean_interval = 86400 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] reservation_expire = 86400 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] reserved_image_namespaces = [] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] reserved_percentage = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] rpc_response_timeout = 120 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] run_external_periodic_tasks = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] scst_target_driver = iscsi {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] scst_target_iqn_name = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] service_down_time = 720 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] shell_completion = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] snapshot_name_template = snapshot-%s {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] snapshot_same_host = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] split_loggers = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] state_path = /opt/stack/data/cinder {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] storage_availability_zone = nova {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] storage_protocol = iSCSI {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] syslog_log_facility = LOG_USER {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] target_helper = lioadm {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] target_ip_address = 192.168.122.99 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] target_port = 3260 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] target_protocol = iscsi {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] target_secondary_ip_addresses = [] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] trace_flags = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] transfer_api_class = cinder.transfer.api.API {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] transport_url = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] until_refresh = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] use_chap_auth = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] use_default_quota_class = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] use_journal = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] use_json = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] use_multipath_for_image_xfer = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] use_stderr = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] use_syslog = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] verify_glance_signatures = enabled {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] volume_api_class = cinder.volume.api.API {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] volume_backend_name = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] volume_clear = zero {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] volume_clear_ionice = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] volume_clear_size = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] volume_copy_bps_limit = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] volume_dd_blocksize = 1M {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] volume_name_template = volume-%s {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] volume_service_inithost_offload = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] volume_usage_audit_period = month {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] zoning_mode = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_concurrency.disable_process_locking = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[77149]: INFO cinder.volume.manager [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.auth_section = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.auth_type = password {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.auth_version = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.cache = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.certfile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.delay_auth_decision = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.http_connect_timeout = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.include_service_catalog = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.insecure = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.interface = public {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.keyfile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.memcache_password = {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.memcache_username = {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.region_name = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.service_token_roles_required = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.service_type = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.token_cache_time = 300 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.99/identity {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.backend = dogpile.cache.null {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.backend_argument = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.backend_expiration_time = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.config_prefix = cache.oslo {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.debug_cache_backend = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.enable_retry_client = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.enable_socket_keepalive = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.enabled = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.expiration_time = 600 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.hashclient_retry_attempts = 2 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.memcache_dead_retry = 300 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.memcache_pool_maxsize = 10 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.memcache_sasl_enabled = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.password = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.proxies = [] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.redis_db = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.redis_sentinel_service_name = mymaster {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.redis_server = localhost:6379 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.retry_attempts = 2 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.retry_delay = 0.0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.socket_keepalive_count = 1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.socket_keepalive_idle = 1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.socket_keepalive_interval = 1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.socket_timeout = 1.0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.tls_allowed_ciphers = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.tls_cafile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.tls_certfile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.tls_enabled = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.tls_keyfile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cache.username = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] coordination.backend_url = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.asyncio_connection = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.asyncio_slave_connection = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.backend = sqlalchemy {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.connection = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.connection_debug = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.connection_parameters = {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.connection_recycle_time = 3600 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.connection_trace = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.db_inc_retry_interval = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.db_max_retries = 20 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.db_max_retry_interval = 10 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.db_retry_interval = 1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.max_overflow = 50 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.max_pool_size = 5 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.max_retries = 10 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.mysql_wsrep_sync_wait = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.pool_timeout = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.retry_interval = 10 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.slave_connection = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.sqlite_synchronous = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.synchronous_reader = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] database.use_db_reconnect = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] profiler.connection_string = messaging:// {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] profiler.enabled = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] profiler.es_doc_type = notification {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] profiler.es_scroll_size = 10000 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] profiler.es_scroll_time = 2m {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] profiler.filter_error_trace = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] profiler.hmac_keys = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] profiler.sentinel_service_name = mymaster {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] profiler.socket_timeout = 0.1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] profiler.trace_requests = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] profiler.trace_sqlalchemy = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] profiler_jaeger.process_tags = {} {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] profiler_jaeger.service_name_prefix = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] profiler_otlp.service_name_prefix = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_policy.enforce_new_defaults = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_policy.enforce_scope = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_policy.policy_default_rule = default {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_policy.policy_file = policy.yaml {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_policy.remote_timeout = 60.0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] privsep_osbrick.group = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] privsep_osbrick.helper_command = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] privsep_osbrick.user = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cinder_sys_admin.group = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cinder_sys_admin.helper_command = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.063s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] cinder_sys_admin.user = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] service_user.auth_section = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] service_user.auth_type = password {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] service_user.cafile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] service_user.certfile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] service_user.collect_timing = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] service_user.insecure = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] service_user.keyfile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] service_user.send_service_user_token = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] service_user.split_loggers = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] service_user.timeout = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance.auth_section = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance.auth_type = password {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance.certfile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance.collect_timing = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance.insecure = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance.keyfile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance.region_name = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance.split_loggers = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] glance.timeout = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.backend_availability_zone = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.chap_password = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.chap_username = {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.disk_geometry = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.driver_client_cert = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.driver_client_cert_key = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.driver_data_namespace = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.driver_use_ssl = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.enable_unsupported_driver = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.extra_capabilities = {} {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.filter_function = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.goodness_function = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.iscsi_target_flags = {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.iscsi_write_cache = on {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.iser_helper = tgtadm {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.iser_ip_address = 192.168.122.99 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.iser_port = 3260 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.lvm_mirrors = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.lvm_share_target = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.lvm_type = auto {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.num_shell_tries = 3 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.nvmet_port_id = 1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.replication_device = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.report_discard_supported = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.reserved_percentage = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.scst_target_driver = iscsi {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.scst_target_iqn_name = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.storage_protocol = iSCSI {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.target_helper = tgtadm {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.target_ip_address = 192.168.122.99 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.target_port = 3260 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.target_protocol = iscsi {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.trace_flags = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.unique_fqdn_network = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.use_chap_auth = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.volume_backend_name = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.volume_clear = zero {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.volume_clear_ionice = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.volume_clear_size = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.volume_group = cinder-volumes {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_reports.file_event_handler = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_reports.log_dir = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.backend_availability_zone = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.backend_host = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.chap_password = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.chap_username = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.chiscsi_conf = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.disk_geometry = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.driver_client_cert = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.driver_data_namespace = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.driver_use_ssl = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.extra_capabilities = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.filter_function = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.goodness_function = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.iser_helper = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.iser_ip_address = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.iser_port = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.iser_target_prefix = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.lvm_conf_file = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.lvm_mirrors = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.lvm_share_target = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.lvm_type = auto {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.num_shell_tries = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.nvmet_port_id = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.replication_device = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.report_discard_supported = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.reserved_percentage = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.scst_target_driver = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.storage_protocol = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.target_helper = lioadm {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.target_ip_address = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.target_port = 3260 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.target_protocol = iscsi {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.trace_flags = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.use_chap_auth = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.volume_clear = zero {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.volume_clear_size = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] lvmdriver-1.volumes_dir = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.058s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.ssl = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.ssl_version = {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_notifications.driver = [] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_notifications.retry = -1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] oslo_messaging_notifications.transport_url = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] key_manager.fixed_key = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican.barbican_api_version = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican.barbican_endpoint = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican.barbican_endpoint_type = public {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican.barbican_region_name = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican.cafile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican.certfile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican.collect_timing = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican.insecure = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican.keyfile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican.number_of_retries = 60 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican.retry_delay = 1 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican.send_service_user_token = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican.split_loggers = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican.timeout = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican.verify_ssl = True {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican.verify_ssl_path = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican_service_user.auth_section = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican_service_user.auth_type = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican_service_user.cafile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican_service_user.certfile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican_service_user.collect_timing = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican_service_user.insecure = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican_service_user.keyfile = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican_service_user.split_loggers = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] barbican_service_user.timeout = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] vault.approle_role_id = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] vault.approle_secret_id = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] vault.auth_method = approle {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] vault.auth_path = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] vault.kv_mountpoint = secret {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] vault.kv_path = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] vault.kv_version = 2 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] vault.namespace = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] vault.root_token_id = **** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] vault.ssl_ca_crt_file = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] vault.timeout = 60.0 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] vault.token_file = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] vault.token_role = None {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] vault.use_ssl = False {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:05:36 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] ******************************************************************************** {{(pid=76997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 14 21:05:36 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:36 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:36 devstack sudo[77153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 14 21:05:36 devstack sudo[77153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:37 devstack sudo[77153]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:37 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:37 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:37 devstack sudo[77207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 21:05:37 devstack sudo[77207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:37 devstack sudo[77207]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:37 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.254s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:37 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:05:37 devstack cinder-volume[77149]: INFO cinder.brick.local_dev.lvm [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 14 21:05:37 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:37 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:37 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:37 devstack sudo[77323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 21:05:37 devstack sudo[77323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:37 devstack sudo[77323]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:37 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:37 devstack cinder-volume[77149]: DEBUG cinder.brick.local_dev.lvm [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77149) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 14 21:05:37 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:37 devstack sudo[77409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 21:05:37 devstack sudo[77409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:38 devstack sudo[77409]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:38 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.531s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:38 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:38 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:38 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:38 devstack sudo[77604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 21:05:38 devstack sudo[77604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:38 devstack sudo[77604]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:38 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:38 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:38 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:38 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:38 devstack sudo[77680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 14 21:05:38 devstack sudo[77680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:38 devstack sudo[77680]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:38 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.308s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:38 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:38 devstack sudo[77758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 21:05:38 devstack sudo[77758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:39 devstack sudo[77758]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:39 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:39 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:39 devstack sudo[77769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 21:05:39 devstack sudo[77769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:39 devstack sudo[77769]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:39 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.338s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:39 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:39 devstack sudo[77847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:05:39 devstack sudo[77847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:39 devstack sudo[77847]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:39 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:39 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:39 devstack sudo[77856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 21:05:39 devstack sudo[77856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:39 devstack sudo[77856]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:40 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.317s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:40 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:40 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:40 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:40 devstack sudo[77941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 21:05:40 devstack sudo[77941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:40 devstack sudo[77941]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:40 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:40 devstack cinder-volume[77149]: INFO cinder.volume.drivers.lvm [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 14 21:05:40 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:40 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:40 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:40 devstack sudo[77945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 21:05:40 devstack sudo[77945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:40 devstack sudo[77945]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:40 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:40 devstack cinder-volume[77149]: DEBUG cinder.volume.drivers.lvm [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Updating volume stats {{(pid=77149) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 21:05:40 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:40 devstack sudo[77948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 21:05:40 devstack sudo[77948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:40 devstack sudo[77948]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:40 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:40 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:40 devstack sudo[77952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:05:40 devstack sudo[77952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:41 devstack sudo[77952]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:41 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:41 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:41 devstack sudo[77955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 21:05:41 devstack sudo[77955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:41 devstack sudo[77955]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:41 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:41 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:41 devstack sudo[77958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:05:41 devstack sudo[77958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:41 devstack sudo[77958]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:41 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:41 devstack cinder-volume[77149]: INFO cinder.volume.driver [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Driver hasn't implemented _init_vendor_properties() Jul 14 21:05:41 devstack cinder-volume[77149]: DEBUG cinder.volume.driver [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77149) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 14 21:05:41 devstack cinder-volume[77149]: DEBUG oslo_db.sqlalchemy.engines [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77149) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 21:05:41 devstack cinder-volume[77149]: DEBUG dbcounter [-] [77149] Writer thread running {{(pid=77149) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 21:05:41 devstack cinder-volume[77149]: DEBUG cinder.db.api [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Building query based on filter {{(pid=77149) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 14 21:05:41 devstack cinder-volume[77149]: DEBUG cinder.image.image_utils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77149) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 14 21:05:41 devstack cinder-volume[77149]: INFO cinder.keymgr.migration [None req-8bda96a6-c3c5-42ed-b9e8-1f6a02700360 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 14 21:05:41 devstack cinder-volume[77149]: DEBUG cinder.volume.drivers.lvm [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Updating volume stats {{(pid=77149) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 21:05:41 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:41 devstack sudo[77961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 21:05:41 devstack sudo[77961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:42 devstack sudo[77961]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:42 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:42 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:42 devstack sudo[77965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:05:42 devstack sudo[77965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:42 devstack sudo[77965]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:42 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:42 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:42 devstack sudo[77969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 21:05:42 devstack sudo[77969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:42 devstack sudo[77969]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:42 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:42 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:42 devstack sudo[77972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:05:42 devstack sudo[77972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:42 devstack sudo[77972]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:42 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:42 devstack cinder-volume[77149]: DEBUG cinder.manager [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Notifying Schedulers of capabilities ... {{(pid=77149) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:05:42 devstack cinder-volume[77149]: INFO cinder.volume.manager [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Driver initialization completed successfully. Jul 14 21:05:42 devstack cinder-volume[77149]: INFO cinder.manager [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Initiating service 2 cleanup Jul 14 21:05:42 devstack cinder-volume[77149]: INFO cinder.manager [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Service 2 cleanup completed. Jul 14 21:05:42 devstack cinder-volume[77149]: DEBUG cinder.service [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Creating RPC server for service cinder-volume {{(pid=77149) start /opt/stack/cinder/cinder/service.py:231}} Jul 14 21:05:42 devstack cinder-volume[77149]: DEBUG cinder.service [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77149) start /opt/stack/cinder/cinder/service.py:237}} Jul 14 21:05:43 devstack cinder-volume[77149]: INFO cinder.volume.manager [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 14 21:05:43 devstack cinder-volume[77149]: DEBUG cinder.volume.drivers.lvm [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Updating volume stats {{(pid=77149) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 21:05:43 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:43 devstack sudo[77983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 21:05:43 devstack sudo[77983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:43 devstack sudo[77983]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:43 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:43 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:43 devstack sudo[77986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:05:43 devstack sudo[77986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:43 devstack sudo[77986]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:43 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:43 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:43 devstack sudo[77989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 21:05:43 devstack sudo[77989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:43 devstack sudo[77989]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:43 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:43 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:05:43 devstack sudo[77992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:05:43 devstack sudo[77992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:05:44 devstack sudo[77992]: pam_unix(sudo:session): session closed for user root Jul 14 21:05:44 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:05:44 devstack cinder-volume[77149]: INFO cinder.volume.manager [None req-b98403a6-54a6-4bcc-9869-8082db36c491 None None] Driver post RPC initialization completed successfully. Jul 14 21:05:46 devstack cinder-volume[76997]: DEBUG dbcounter [-] [76997] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76997) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:05:54 devstack cinder-volume[77149]: DEBUG dbcounter [-] [77149] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77149) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:05:54 devstack cinder-volume[77149]: DEBUG dbcounter [-] [77149] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=77149) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:05:57 devstack cinder-volume[77149]: DEBUG oslo_service.periodic_task [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running periodic task VolumeManager._thread_info {{(pid=77149) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:05:57 devstack cinder-volume[77149]: DEBUG cinder.volume.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] thread count: 6 {{(pid=77149) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:05:57 devstack cinder-volume[77149]: DEBUG cinder.volume.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] thread info: [<_MainThread(MainThread, started 128351877460096)>, , , , , ] {{(pid=77149) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:06:57 devstack cinder-volume[77149]: DEBUG oslo_service.periodic_task [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77149) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:06:57 devstack cinder-volume[77149]: DEBUG cinder.volume.drivers.lvm [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Updating volume stats {{(pid=77149) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 21:06:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:06:57 devstack sudo[78227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 21:06:57 devstack sudo[78227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:06:57 devstack sudo[78227]: pam_unix(sudo:session): session closed for user root Jul 14 21:06:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:06:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:06:57 devstack sudo[78230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:06:57 devstack sudo[78230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:06:57 devstack sudo[78230]: pam_unix(sudo:session): session closed for user root Jul 14 21:06:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:06:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:06:57 devstack sudo[78233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 21:06:57 devstack sudo[78233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:06:57 devstack sudo[78233]: pam_unix(sudo:session): session closed for user root Jul 14 21:06:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:06:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:06:57 devstack sudo[78236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:06:57 devstack sudo[78236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:06:58 devstack sudo[78236]: pam_unix(sudo:session): session closed for user root Jul 14 21:06:58 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:06:58 devstack cinder-volume[77149]: DEBUG cinder.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Notifying Schedulers of capabilities ... {{(pid=77149) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:06:58 devstack cinder-volume[77149]: DEBUG oslo_service.periodic_task [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running periodic task VolumeManager._thread_info {{(pid=77149) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:06:58 devstack cinder-volume[77149]: DEBUG cinder.volume.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] thread count: 6 {{(pid=77149) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:06:58 devstack cinder-volume[77149]: DEBUG cinder.volume.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] thread info: [<_MainThread(MainThread, started 128351877460096)>, , , , , ] {{(pid=77149) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:07:54 devstack cinder-volume[77149]: DEBUG dbcounter [-] [77149] Writing DB stats cinder:SELECT=1 {{(pid=77149) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:07:54 devstack cinder-volume[77149]: DEBUG dbcounter [-] [77149] Writing DB stats cinder:UPDATE=1 {{(pid=77149) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:07:57 devstack cinder-volume[77149]: DEBUG oslo_service.periodic_task [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77149) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:07:57 devstack cinder-volume[77149]: DEBUG cinder.volume.drivers.lvm [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Updating volume stats {{(pid=77149) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 21:07:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:07:57 devstack sudo[78300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 21:07:57 devstack sudo[78300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:07:57 devstack sudo[78300]: pam_unix(sudo:session): session closed for user root Jul 14 21:07:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:07:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:07:57 devstack sudo[78303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:07:57 devstack sudo[78303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:07:57 devstack sudo[78303]: pam_unix(sudo:session): session closed for user root Jul 14 21:07:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:07:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:07:57 devstack sudo[78306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 21:07:57 devstack sudo[78306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:07:57 devstack sudo[78306]: pam_unix(sudo:session): session closed for user root Jul 14 21:07:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:07:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:07:57 devstack sudo[78309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:07:57 devstack sudo[78309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:07:58 devstack sudo[78309]: pam_unix(sudo:session): session closed for user root Jul 14 21:07:58 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:07:58 devstack cinder-volume[77149]: DEBUG cinder.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Notifying Schedulers of capabilities ... {{(pid=77149) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:07:58 devstack cinder-volume[77149]: DEBUG oslo_service.periodic_task [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running periodic task VolumeManager._thread_info {{(pid=77149) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:07:58 devstack cinder-volume[77149]: DEBUG cinder.volume.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] thread count: 6 {{(pid=77149) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:07:58 devstack cinder-volume[77149]: DEBUG cinder.volume.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] thread info: [<_MainThread(MainThread, started 128351877460096)>, , , , , ] {{(pid=77149) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:08:57 devstack cinder-volume[77149]: DEBUG oslo_service.periodic_task [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77149) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:08:57 devstack cinder-volume[77149]: DEBUG cinder.volume.drivers.lvm [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Updating volume stats {{(pid=77149) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 21:08:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:08:57 devstack sudo[79075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 21:08:57 devstack sudo[79075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:08:57 devstack sudo[79075]: pam_unix(sudo:session): session closed for user root Jul 14 21:08:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:08:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:08:57 devstack sudo[79078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:08:57 devstack sudo[79078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:08:57 devstack sudo[79078]: pam_unix(sudo:session): session closed for user root Jul 14 21:08:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:08:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:08:57 devstack sudo[79084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 21:08:57 devstack sudo[79084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:08:57 devstack sudo[79084]: pam_unix(sudo:session): session closed for user root Jul 14 21:08:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:08:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:08:57 devstack sudo[79087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:08:57 devstack sudo[79087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:08:58 devstack sudo[79087]: pam_unix(sudo:session): session closed for user root Jul 14 21:08:58 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:08:58 devstack cinder-volume[77149]: DEBUG cinder.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Notifying Schedulers of capabilities ... {{(pid=77149) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:08:58 devstack cinder-volume[77149]: DEBUG oslo_service.periodic_task [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running periodic task VolumeManager._thread_info {{(pid=77149) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:08:58 devstack cinder-volume[77149]: DEBUG cinder.volume.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] thread count: 6 {{(pid=77149) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:08:58 devstack cinder-volume[77149]: DEBUG cinder.volume.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] thread info: [<_MainThread(MainThread, started 128351877460096)>, , , , , ] {{(pid=77149) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:09:54 devstack cinder-volume[77149]: DEBUG dbcounter [-] [77149] Writing DB stats cinder:SELECT=1 {{(pid=77149) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:09:54 devstack cinder-volume[77149]: DEBUG dbcounter [-] [77149] Writing DB stats cinder:UPDATE=1 {{(pid=77149) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:09:57 devstack cinder-volume[77149]: DEBUG oslo_service.periodic_task [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77149) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:09:57 devstack cinder-volume[77149]: DEBUG cinder.volume.drivers.lvm [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Updating volume stats {{(pid=77149) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 21:09:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:09:57 devstack sudo[80804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 21:09:57 devstack sudo[80804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:09:57 devstack sudo[80804]: pam_unix(sudo:session): session closed for user root Jul 14 21:09:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:09:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:09:57 devstack sudo[80807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:09:57 devstack sudo[80807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:09:57 devstack sudo[80807]: pam_unix(sudo:session): session closed for user root Jul 14 21:09:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:09:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:09:57 devstack sudo[80810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 21:09:57 devstack sudo[80810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:09:57 devstack sudo[80810]: pam_unix(sudo:session): session closed for user root Jul 14 21:09:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:09:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:09:57 devstack sudo[80813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:09:57 devstack sudo[80813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:09:58 devstack sudo[80813]: pam_unix(sudo:session): session closed for user root Jul 14 21:09:58 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:09:58 devstack cinder-volume[77149]: DEBUG cinder.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Notifying Schedulers of capabilities ... {{(pid=77149) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:09:58 devstack cinder-volume[77149]: DEBUG oslo_service.periodic_task [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running periodic task VolumeManager._thread_info {{(pid=77149) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:09:58 devstack cinder-volume[77149]: DEBUG cinder.volume.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] thread count: 6 {{(pid=77149) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:09:58 devstack cinder-volume[77149]: DEBUG cinder.volume.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] thread info: [<_MainThread(MainThread, started 128351877460096)>, , , , , ] {{(pid=77149) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:10:57 devstack cinder-volume[77149]: DEBUG oslo_service.periodic_task [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77149) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:10:57 devstack cinder-volume[77149]: DEBUG cinder.volume.drivers.lvm [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Updating volume stats {{(pid=77149) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 21:10:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:10:57 devstack sudo[83788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 21:10:57 devstack sudo[83788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:10:57 devstack sudo[83788]: pam_unix(sudo:session): session closed for user root Jul 14 21:10:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:10:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:10:57 devstack sudo[83792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:10:57 devstack sudo[83792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:10:57 devstack sudo[83792]: pam_unix(sudo:session): session closed for user root Jul 14 21:10:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:10:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:10:57 devstack sudo[83795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 21:10:57 devstack sudo[83795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:10:57 devstack sudo[83795]: pam_unix(sudo:session): session closed for user root Jul 14 21:10:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:10:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:10:57 devstack sudo[83799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:10:57 devstack sudo[83799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:10:58 devstack sudo[83799]: pam_unix(sudo:session): session closed for user root Jul 14 21:10:58 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:10:58 devstack cinder-volume[77149]: DEBUG cinder.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Notifying Schedulers of capabilities ... {{(pid=77149) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:11:54 devstack cinder-volume[77149]: DEBUG dbcounter [-] [77149] Writing DB stats cinder:SELECT=1 {{(pid=77149) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:11:54 devstack cinder-volume[77149]: DEBUG dbcounter [-] [77149] Writing DB stats cinder:UPDATE=1 {{(pid=77149) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:11:57 devstack cinder-volume[77149]: DEBUG oslo_service.periodic_task [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77149) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:11:57 devstack cinder-volume[77149]: DEBUG cinder.volume.drivers.lvm [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Updating volume stats {{(pid=77149) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 21:11:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:11:57 devstack sudo[85740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 21:11:57 devstack sudo[85740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:11:57 devstack sudo[85740]: pam_unix(sudo:session): session closed for user root Jul 14 21:11:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:11:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:11:57 devstack sudo[85760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:11:57 devstack sudo[85760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:11:57 devstack sudo[85760]: pam_unix(sudo:session): session closed for user root Jul 14 21:11:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:11:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:11:57 devstack sudo[85794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 21:11:57 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:11:57 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root Jul 14 21:11:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:11:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:11:58 devstack sudo[85808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:11:58 devstack sudo[85808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:11:58 devstack sudo[85808]: pam_unix(sudo:session): session closed for user root Jul 14 21:11:58 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:11:58 devstack cinder-volume[77149]: DEBUG cinder.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Notifying Schedulers of capabilities ... {{(pid=77149) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:11:58 devstack cinder-volume[77149]: DEBUG oslo_service.periodic_task [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running periodic task VolumeManager._thread_info {{(pid=77149) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:11:58 devstack cinder-volume[77149]: DEBUG cinder.volume.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] thread count: 6 {{(pid=77149) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:11:58 devstack cinder-volume[77149]: DEBUG cinder.volume.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] thread info: [<_MainThread(MainThread, started 128351877460096)>, , , , , ] {{(pid=77149) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:12:57 devstack cinder-volume[77149]: DEBUG oslo_service.periodic_task [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77149) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:12:57 devstack cinder-volume[77149]: DEBUG cinder.volume.drivers.lvm [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Updating volume stats {{(pid=77149) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 14 21:12:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:12:57 devstack sudo[86949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 14 21:12:57 devstack sudo[86949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:12:57 devstack sudo[86949]: pam_unix(sudo:session): session closed for user root Jul 14 21:12:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:12:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:12:57 devstack sudo[86953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:12:57 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:12:57 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root Jul 14 21:12:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:12:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:12:57 devstack sudo[86956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 14 21:12:57 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:12:57 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root Jul 14 21:12:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:12:57 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:12:57 devstack sudo[86970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 14 21:12:58 devstack sudo[86970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:12:58 devstack sudo[86970]: pam_unix(sudo:session): session closed for user root Jul 14 21:12:58 devstack cinder-volume[77149]: DEBUG oslo_concurrency.processutils [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:12:58 devstack cinder-volume[77149]: DEBUG cinder.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Notifying Schedulers of capabilities ... {{(pid=77149) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:12:58 devstack cinder-volume[77149]: DEBUG oslo_service.periodic_task [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] Running periodic task VolumeManager._thread_info {{(pid=77149) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:12:58 devstack cinder-volume[77149]: DEBUG cinder.volume.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] thread count: 6 {{(pid=77149) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:12:58 devstack cinder-volume[77149]: DEBUG cinder.volume.manager [None req-68a930be-5032-43ee-afa8-21378ef3c5fe None None] thread info: [<_MainThread(MainThread, started 128351877460096)>, , , , , ] {{(pid=77149) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:13:07 devstack cinder-volume[76997]: INFO oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Caught SIGTERM, stopping children Jul 14 21:13:07 devstack cinder-volume[76997]: DEBUG oslo_concurrency.lockutils [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Acquiring lock "singleton_lock" {{(pid=76997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 21:13:07 devstack cinder-volume[76997]: DEBUG oslo_concurrency.lockutils [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Acquired lock "singleton_lock" {{(pid=76997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 21:13:07 devstack cinder-volume[76997]: DEBUG oslo_concurrency.lockutils [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Releasing lock "singleton_lock" {{(pid=76997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 21:13:07 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Stop services. {{(pid=76997) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 14 21:13:07 devstack cinder-volume[76997]: DEBUG oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Killing children. {{(pid=76997) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 14 21:13:07 devstack cinder-volume[76997]: INFO oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Waiting on 1 children to exit Jul 14 21:13:08 devstack cinder-volume[77149]: DEBUG oslo_concurrency.lockutils [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Acquiring lock "singleton_lock" {{(pid=77149) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 21:13:08 devstack cinder-volume[77149]: DEBUG oslo_concurrency.lockutils [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Acquired lock "singleton_lock" {{(pid=77149) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 21:13:08 devstack cinder-volume[77149]: DEBUG oslo_concurrency.lockutils [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Releasing lock "singleton_lock" {{(pid=77149) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 21:13:08 devstack cinder-volume[77149]: WARNING amqp [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 14 21:13:08 devstack cinder-volume[77149]: WARNING amqp [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 14 21:13:08 devstack cinder-volume[76997]: INFO oslo_service.backend._eventlet.service [None req-f5f2ac9c-331a-4697-8aed-99deba88fe6f None None] Child 77149 exited with status 0 Jul 14 21:13:08 devstack cinder-volume[87339]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 14 21:13:08 devstack cinder-volume[87339]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 14 21:13:08 devstack cinder-volume[87339]: we strongly recommend against using it for new projects. Jul 14 21:13:08 devstack cinder-volume[87339]: If you are already using Eventlet, we recommend migrating to a different Jul 14 21:13:08 devstack cinder-volume[87339]: framework. For more detail see Jul 14 21:13:08 devstack cinder-volume[87339]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 14 21:13:08 devstack cinder-volume[87339]: import eventlet # noqa Jul 14 21:13:10 devstack cinder-volume[87339]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 21:13:10 devstack cinder-volume[87339]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 21:13:10 devstack cinder-volume[87339]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 21:13:11 devstack cinder-volume[87339]: INFO dbcounter [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Registered counter for database cinder Jul 14 21:13:11 devstack cinder-volume[87339]: DEBUG oslo_db.sqlalchemy.engines [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 21:13:11 devstack cinder-volume[87339]: DEBUG dbcounter [-] [87339] Writer thread running {{(pid=87339) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 21:13:11 devstack cinder-volume[87339]: INFO cinder.rpc [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 14 21:13:11 devstack cinder-volume[87339]: INFO cinder.rpc [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 14 21:13:11 devstack cinder-volume[87339]: DEBUG oslo_db.sqlalchemy.engines [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 21:13:11 devstack cinder-volume[87339]: INFO cinder.volume.manager [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Determined volume DB was empty at startup. Jul 14 21:13:11 devstack cinder-volume[87339]: DEBUG cinder.volume.manager [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87339) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 14 21:13:11 devstack cinder-volume[87339]: INFO cinder.volume.manager [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 14 21:13:11 devstack cinder-volume[87339]: WARNING stevedore.named [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 14 21:13:11 devstack cinder-volume[87339]: WARNING castellan.key_manager [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 21:13:11 devstack cinder-volume[87339]: WARNING cinder.keymgr.conf_key_mgr [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 21:13:11 devstack cinder-volume[87339]: INFO cinder.volume.manager [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 14 21:13:11 devstack cinder-volume[87339]: DEBUG oslo_db.sqlalchemy.engines [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 21:13:12 devstack cinder-volume[87339]: INFO oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Starting 1 workers Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Started child 87641 {{(pid=87339) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Full set of CONF: {{(pid=87339) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] ******************************************************************************** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Configuration options gathered from: {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] ================================================================================ {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] allow_availability_zone_fallback = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] allow_compression_on_image_upload = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] allowed_direct_url_schemes = [] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] api_rate_limit = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] auth_strategy = keystone {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_availability_zone = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_host = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_name = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_stats_polling_interval = 60 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backup_api_class = cinder.backup.api.API {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backup_name_template = backup-%s {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backup_use_same_host = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backup_use_temp_snapshot = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] chap_password = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] chap_username = {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cinder_internal_tenant_project_id = 874d6367a65f4c0790462050b2a6ca38 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cinder_internal_tenant_user_id = d08f2bc499524f11884695337bc27d57 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cluster = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] compression_format = gzip {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] compute_api_class = cinder.compute.nova.API {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] config_dir = [] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87641]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] config_source = [] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] control_exchange = openstack {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] debug = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] default_availability_zone = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] default_group_type = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] default_volume_type = QuobyteHD {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] disk_geometry = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] driver_client_cert = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] driver_client_cert_key = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] driver_data_namespace = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] driver_ssl_cert_path = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] driver_ssl_cert_verify = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] driver_use_ssl = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] enable_new_services = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] enable_unsupported_driver = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] enabled_backends = ['QuobyteHD'] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] enforce_multipath_for_image_xfer = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] filter_function = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance_api_insecure = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance_api_servers = ['http://192.168.122.99/image'] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance_api_ssl_compression = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance_ca_certificates_file = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance_catalog_info = image:glance:publicURL {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance_certfile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance_keyfile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance_num_retries = 3 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance_request_timeout = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] goodness_function = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] graceful_shutdown_timeout = 5 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] group_api_class = cinder.group.api.API {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] host = devstack {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] image_compress_on_upload = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] image_conversion_address_space_limit = 1 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] image_conversion_cpu_limit = 60 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] image_conversion_disable = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] image_upload_use_cinder_backend = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] image_upload_use_internal_tenant = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] image_volume_cache_enabled = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] image_volume_cache_max_count = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] image_volume_cache_max_size_gb = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] init_host_max_objects_retrieval = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] instance_format = [instance: %(uuid)s] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] iscsi_target_flags = {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] iscsi_write_cache = on {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] iser_helper = tgtadm {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] iser_ip_address = 192.168.122.99 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] iser_port = 3260 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] log_color = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] log_config_append = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] log_dir = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] log_file = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] log_options = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] log_rotate_interval = 1 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] log_rotate_interval_type = days {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] log_rotation_type = none {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] max_age = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] max_logfile_count = 30 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] max_logfile_size_mb = 200 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] max_over_subscription_ratio = 20.0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] message_reap_interval = 86400 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] message_ttl = 2592000 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] migration_create_volume_timeout_secs = 300 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] monkey_patch = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] monkey_patch_modules = [] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] my_ip = 192.168.122.99 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] no_snapshot_gb_quota = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] num_iser_scan_tries = 3 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] num_shell_tries = 3 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] num_volume_device_scan_tries = 3 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] nvmeof_conn_info_version = 1 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] nvmet_ns_id = 10 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] nvmet_port_id = 1 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] osapi_max_limit = 1000 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] osapi_volume_ext_list = [] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] osapi_volume_listen_port = 8776 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] osapi_volume_use_ssl = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] osapi_volume_workers = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] per_volume_size_limit = -1 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] periodic_fuzzy_delay = 60 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] periodic_interval = 60 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] public_endpoint = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] publish_errors = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] quota_backup_gigabytes = 1000 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] quota_backups = 10 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] quota_gigabytes = 1000 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] quota_groups = 10 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] quota_snapshots = 10 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] quota_volumes = 10 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] rate_limit_burst = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] rate_limit_except_level = CRITICAL {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] rate_limit_interval = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] reinit_driver_count = 3 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] replication_device = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] report_discard_supported = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] report_interval = 120 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] reservation_clean_interval = 86400 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] reservation_expire = 86400 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] reserved_image_namespaces = [] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] reserved_percentage = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] rpc_response_timeout = 120 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] run_external_periodic_tasks = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] scst_target_driver = iscsi {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] scst_target_iqn_name = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] service_down_time = 720 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] shell_completion = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] snapshot_name_template = snapshot-%s {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] split_loggers = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] state_path = /opt/stack/data/cinder {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] storage_availability_zone = nova {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] storage_protocol = iSCSI {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] syslog_log_facility = LOG_USER {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] target_helper = lioadm {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] target_ip_address = 192.168.122.99 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] target_port = 3260 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] target_protocol = iscsi {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] target_secondary_ip_addresses = [] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] trace_flags = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] transport_url = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] until_refresh = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] use_chap_auth = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] use_default_quota_class = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] use_journal = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] use_json = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] use_multipath_for_image_xfer = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] use_stderr = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] use_syslog = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] verify_glance_signatures = enabled {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] volume_api_class = cinder.volume.api.API {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] volume_backend_name = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] volume_clear = zero {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] volume_clear_ionice = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] volume_clear_size = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] volume_copy_bps_limit = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] volume_dd_blocksize = 1M {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] volume_name_template = volume-%s {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] volume_service_inithost_offload = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] volume_usage_audit_period = month {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] zoning_mode = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_concurrency.disable_process_locking = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.auth_section = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.auth_type = password {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.auth_version = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.cache = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.certfile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.include_service_catalog = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.insecure = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.interface = public {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.keyfile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.memcache_password = {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.memcache_username = {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.region_name = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87641]: INFO cinder.volume.manager [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.service_type = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.99/identity {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.backend = dogpile.cache.null {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.backend_argument = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.backend_expiration_time = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.config_prefix = cache.oslo {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.debug_cache_backend = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.enable_retry_client = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.enable_socket_keepalive = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.enabled = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.expiration_time = 600 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.hashclient_retry_attempts = 2 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87641]: DEBUG cinder.volume.drivers.remotefs [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87641) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.memcache_dead_retry = 300 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.memcache_pool_maxsize = 10 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.memcache_sasl_enabled = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.password = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.proxies = [] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.redis_db = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.redis_server = localhost:6379 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.retry_attempts = 2 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.retry_delay = 0.0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.socket_keepalive_count = 1 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.socket_keepalive_idle = 1 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.socket_keepalive_interval = 1 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.socket_timeout = 1.0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.tls_allowed_ciphers = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.tls_cafile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.tls_certfile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.tls_enabled = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.tls_keyfile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cache.username = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] coordination.backend_url = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.asyncio_connection = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.asyncio_slave_connection = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.backend = sqlalchemy {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.connection = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.connection_debug = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.connection_parameters = {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.connection_recycle_time = 3600 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.connection_trace = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.db_inc_retry_interval = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.db_max_retries = 20 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.db_max_retry_interval = 10 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.db_retry_interval = 1 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.max_overflow = 50 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.max_pool_size = 5 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.max_retries = 10 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.mysql_wsrep_sync_wait = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.pool_timeout = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.retry_interval = 10 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.slave_connection = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.sqlite_synchronous = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.synchronous_reader = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] database.use_db_reconnect = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] profiler.connection_string = messaging:// {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] profiler.enabled = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] profiler.es_doc_type = notification {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] profiler.es_scroll_size = 10000 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] profiler.es_scroll_time = 2m {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] profiler.filter_error_trace = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] profiler.hmac_keys = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] profiler.sentinel_service_name = mymaster {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] profiler.socket_timeout = 0.1 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] profiler.trace_requests = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] profiler.trace_sqlalchemy = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] profiler_jaeger.process_tags = {} {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] profiler_jaeger.service_name_prefix = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] profiler_otlp.service_name_prefix = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_policy.enforce_new_defaults = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_policy.enforce_scope = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_policy.policy_default_rule = default {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_policy.policy_file = policy.yaml {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] privsep_osbrick.group = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] privsep_osbrick.helper_command = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] privsep_osbrick.user = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cinder_sys_admin.group = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cinder_sys_admin.helper_command = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] cinder_sys_admin.user = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] service_user.auth_section = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] service_user.auth_type = password {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] service_user.cafile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] service_user.certfile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] service_user.collect_timing = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] service_user.insecure = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] service_user.keyfile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] service_user.send_service_user_token = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] service_user.split_loggers = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] service_user.timeout = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance.auth_section = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance.auth_type = password {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance.certfile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance.collect_timing = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance.insecure = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance.keyfile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance.region_name = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance.split_loggers = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] glance.timeout = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.backend_availability_zone = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.chap_password = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.chap_username = {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.disk_geometry = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.driver_client_cert = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.driver_client_cert_key = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.driver_data_namespace = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.driver_use_ssl = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.extra_capabilities = {} {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.filter_function = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.goodness_function = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.iscsi_target_flags = {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.iscsi_write_cache = on {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.iser_helper = tgtadm {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.iser_ip_address = 192.168.122.99 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.iser_port = 3260 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.nas_host = {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.nas_login = admin {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.nas_mount_options = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.nas_password = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.nas_private_key = {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.nas_share_path = {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.num_shell_tries = 3 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.quobyte_volume_url = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.replication_device = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.report_discard_supported = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.reserved_percentage = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.target_helper = tgtadm {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.target_ip_address = 192.168.122.99 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.target_port = 3260 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.target_protocol = iscsi {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.trace_flags = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.unique_fqdn_network = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.use_chap_auth = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.volume_backend_name = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.volume_clear = zero {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.volume_clear_ionice = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.volume_clear_size = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_reports.file_event_handler = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_reports.log_dir = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.backend_availability_zone = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.backend_host = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.chap_password = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.chap_username = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.chiscsi_conf = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.disk_geometry = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.driver_client_cert = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.driver_data_namespace = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.driver_use_ssl = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.extra_capabilities = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.filter_function = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.goodness_function = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87641]: DEBUG cinder.volume.drivers.quobyte [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87641) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 14 21:13:12 devstack cinder-volume[87641]: WARNING cinder.volume.drivers.quobyte [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 14 21:13:12 devstack cinder-volume[87641]: WARNING cinder.volume.drivers.quobyte [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.iser_helper = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87641]: DEBUG oslo_concurrency.processutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Running cmd (subprocess): mount.quobyte {{(pid=87641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.iser_ip_address = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.iser_port = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.iser_target_prefix = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.nas_host = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.nas_login = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.nas_mount_options = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.nas_password = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.nas_private_key = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.nas_share_path = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.nas_ssh_port = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.num_shell_tries = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.nvmet_port_id = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.replication_device = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.report_discard_supported = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.reserved_percentage = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.scst_target_driver = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.storage_protocol = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.target_helper = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.target_ip_address = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.target_port = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.target_prefix = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.target_protocol = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.trace_flags = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.use_chap_auth = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.volume_clear = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.volume_clear_size = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] QuobyteHD.volumes_dir = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.ssl = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_notifications.driver = [] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_notifications.retry = -1 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] key_manager.fixed_key = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican.barbican_api_version = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican.barbican_endpoint = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican.barbican_endpoint_type = public {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican.barbican_region_name = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican.cafile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican.certfile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican.collect_timing = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican.insecure = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican.keyfile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican.number_of_retries = 60 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican.retry_delay = 1 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican.send_service_user_token = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican.split_loggers = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican.timeout = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican.verify_ssl = True {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican.verify_ssl_path = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican_service_user.auth_section = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican_service_user.auth_type = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican_service_user.cafile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican_service_user.certfile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican_service_user.collect_timing = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican_service_user.insecure = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican_service_user.keyfile = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican_service_user.split_loggers = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] barbican_service_user.timeout = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] vault.approle_role_id = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] vault.approle_secret_id = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] vault.auth_method = approle {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] vault.auth_path = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] vault.kv_mountpoint = secret {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] vault.kv_path = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] vault.kv_version = 2 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] vault.namespace = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] vault.root_token_id = **** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] vault.ssl_ca_crt_file = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] vault.timeout = 60.0 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] vault.token_file = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] vault.token_role = None {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] vault.use_ssl = False {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:12 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] ******************************************************************************** {{(pid=87339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 14 21:13:12 devstack quobyte-client[87655]: Reading configuration file: /etc/quobyte/client.cfg Jul 14 21:13:12 devstack quobyte-client[87655]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 14 21:13:12 devstack cinder-volume[87641]: DEBUG oslo_concurrency.processutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] CMD "mount.quobyte" returned: 1 in 0.179s {{(pid=87641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:13:12 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:13:12 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:13:12 devstack cinder-volume[87641]: DEBUG cinder.volume.drivers.quobyte [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=87641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:13:12 devstack cinder-volume[87641]: INFO cinder.volume.drivers.quobyte [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 ... Jul 14 21:13:12 devstack cinder-volume[87641]: DEBUG oslo_concurrency.processutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 -c /etc/quobyte/client-cinder.cfg {{(pid=87641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:13:12 devstack sudo[87660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 -c /etc/quobyte/client-cinder.cfg Jul 14 21:13:12 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:13:12 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root Jul 14 21:13:12 devstack cinder-volume[87641]: DEBUG oslo_concurrency.processutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.381s {{(pid=87641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:13:12 devstack cinder-volume[87641]: INFO cinder.volume.drivers.quobyte [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 succeeded Jul 14 21:13:12 devstack cinder-volume[87641]: DEBUG cinder.volume.drivers.quobyte [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=87641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:13:12 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.394s {{(pid=87641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:13:12 devstack cinder-volume[87641]: DEBUG oslo_concurrency.processutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=87641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:13:12 devstack sudo[87733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:13:12 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:13:13 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG oslo_concurrency.processutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.243s {{(pid=87641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:13:13 devstack cinder-volume[87641]: INFO cinder.volume.driver [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Driver hasn't implemented _init_vendor_properties() Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG cinder.volume.driver [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87641) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG oslo_db.sqlalchemy.engines [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87641) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG dbcounter [-] [87641] Writer thread running {{(pid=87641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG cinder.db.api [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Building query based on filter {{(pid=87641) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG cinder.image.image_utils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87641) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 14 21:13:13 devstack cinder-volume[87641]: INFO cinder.keymgr.migration [None req-37bf01ee-9957-48cf-b204-02723847ff78 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG cinder.volume.drivers.quobyte [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=87641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG cinder.volume.drivers.quobyte [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=87641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG oslo_concurrency.processutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=87641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:13:13 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:13:13 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:13:13 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG oslo_concurrency.processutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.236s {{(pid=87641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG cinder.manager [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Notifying Schedulers of capabilities ... {{(pid=87641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:13:13 devstack cinder-volume[87641]: INFO cinder.volume.manager [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Driver initialization completed successfully. Jul 14 21:13:13 devstack cinder-volume[87641]: INFO cinder.manager [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Initiating service 3 cleanup Jul 14 21:13:13 devstack cinder-volume[87641]: INFO cinder.manager [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Service 3 cleanup completed. Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG cinder.service [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Creating RPC server for service cinder-volume {{(pid=87641) start /opt/stack/cinder/cinder/service.py:231}} Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG cinder.service [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87641) start /opt/stack/cinder/cinder/service.py:237}} Jul 14 21:13:13 devstack cinder-volume[87641]: INFO cinder.volume.manager [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG cinder.volume.drivers.quobyte [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=87641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG cinder.volume.drivers.quobyte [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=87641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG oslo_concurrency.processutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=87641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:13:13 devstack sudo[87740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:13:13 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:13:13 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root Jul 14 21:13:13 devstack cinder-volume[87641]: DEBUG oslo_concurrency.processutils [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.249s {{(pid=87641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:13:13 devstack cinder-volume[87641]: INFO cinder.volume.manager [None req-86427344-764e-4ab9-b018-707fe5c6a187 None None] Driver post RPC initialization completed successfully. Jul 14 21:13:18 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-c5478919-f6e2-49c2-82e2-2c072c838642 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:13:18 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-c5478919-f6e2-49c2-82e2-2c072c838642 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:13:18 devstack cinder-volume[87641]: DEBUG cinder.volume.drivers.quobyte [None req-c5478919-f6e2-49c2-82e2-2c072c838642 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=87641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:13:18 devstack cinder-volume[87641]: DEBUG cinder.volume.drivers.quobyte [None req-c5478919-f6e2-49c2-82e2-2c072c838642 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=87641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:13:18 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-c5478919-f6e2-49c2-82e2-2c072c838642 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:13:18 devstack cinder-volume[87641]: DEBUG oslo_concurrency.processutils [None req-c5478919-f6e2-49c2-82e2-2c072c838642 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=87641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:13:18 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:13:18 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:13:18 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Jul 14 21:13:18 devstack cinder-volume[87641]: DEBUG oslo_concurrency.processutils [None req-c5478919-f6e2-49c2-82e2-2c072c838642 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.249s {{(pid=87641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:13:18 devstack cinder-volume[87641]: DEBUG cinder.manager [None req-c5478919-f6e2-49c2-82e2-2c072c838642 None None] Notifying Schedulers of capabilities ... {{(pid=87641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:13:21 devstack cinder-volume[87339]: DEBUG dbcounter [-] [87339] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87339) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:13:22 devstack cinder-volume[87339]: INFO oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Caught SIGTERM, stopping children Jul 14 21:13:22 devstack cinder-volume[87339]: DEBUG oslo_concurrency.lockutils [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Acquiring lock "singleton_lock" {{(pid=87339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 21:13:22 devstack cinder-volume[87339]: DEBUG oslo_concurrency.lockutils [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Acquired lock "singleton_lock" {{(pid=87339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 21:13:22 devstack cinder-volume[87339]: DEBUG oslo_concurrency.lockutils [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Releasing lock "singleton_lock" {{(pid=87339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 21:13:22 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Stop services. {{(pid=87339) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 14 21:13:22 devstack cinder-volume[87339]: DEBUG oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Killing children. {{(pid=87339) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 14 21:13:22 devstack cinder-volume[87339]: INFO oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Waiting on 1 children to exit Jul 14 21:13:23 devstack cinder-volume[87641]: DEBUG dbcounter [-] [87641] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:13:23 devstack cinder-volume[87641]: DEBUG dbcounter [-] [87641] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=87641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:13:26 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Acquiring lock "singleton_lock" {{(pid=87641) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 21:13:26 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Acquired lock "singleton_lock" {{(pid=87641) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 21:13:26 devstack cinder-volume[87641]: DEBUG oslo_concurrency.lockutils [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Releasing lock "singleton_lock" {{(pid=87641) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 21:13:26 devstack cinder-volume[87641]: WARNING amqp [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 14 21:13:26 devstack cinder-volume[87641]: WARNING amqp [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 14 21:13:26 devstack cinder-volume[87339]: INFO oslo_service.backend._eventlet.service [None req-3f041082-9cee-41a5-acb6-d2a19eeb9355 None None] Child 87641 exited with status 0 Jul 14 21:13:27 devstack cinder-volume[88012]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 14 21:13:27 devstack cinder-volume[88012]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 14 21:13:27 devstack cinder-volume[88012]: we strongly recommend against using it for new projects. Jul 14 21:13:27 devstack cinder-volume[88012]: If you are already using Eventlet, we recommend migrating to a different Jul 14 21:13:27 devstack cinder-volume[88012]: framework. For more detail see Jul 14 21:13:27 devstack cinder-volume[88012]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 14 21:13:27 devstack cinder-volume[88012]: import eventlet # noqa Jul 14 21:13:29 devstack cinder-volume[88012]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 14 21:13:29 devstack cinder-volume[88012]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 14 21:13:29 devstack cinder-volume[88012]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 14 21:13:30 devstack cinder-volume[88012]: INFO dbcounter [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] Registered counter for database cinder Jul 14 21:13:30 devstack cinder-volume[88012]: DEBUG oslo_db.sqlalchemy.engines [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88012) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 21:13:30 devstack cinder-volume[88012]: DEBUG dbcounter [-] [88012] Writer thread running {{(pid=88012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 21:13:30 devstack cinder-volume[88012]: INFO cinder.rpc [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 14 21:13:31 devstack cinder-volume[88012]: INFO cinder.rpc [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_db.sqlalchemy.engines [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88012) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 21:13:31 devstack cinder-volume[88012]: INFO cinder.volume.manager [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] Determined volume DB was empty at startup. Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG cinder.volume.manager [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88012) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 14 21:13:31 devstack cinder-volume[88012]: WARNING stevedore.named [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 14 21:13:31 devstack cinder-volume[88012]: WARNING castellan.key_manager [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 21:13:31 devstack cinder-volume[88012]: WARNING cinder.keymgr.conf_key_mgr [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 14 21:13:31 devstack cinder-volume[88012]: INFO cinder.volume.manager [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_db.sqlalchemy.engines [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88012) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 21:13:31 devstack cinder-volume[88012]: INFO oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] Starting 1 workers Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] Started child 88300 {{(pid=88012) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] Full set of CONF: {{(pid=88012) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] ******************************************************************************** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] Configuration options gathered from: {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] ================================================================================ {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] allow_availability_zone_fallback = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] allow_compression_on_image_upload = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] allowed_direct_url_schemes = [] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] api_rate_limit = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] auth_strategy = keystone {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_availability_zone = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_host = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_name = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_stats_polling_interval = 60 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backup_api_class = cinder.backup.api.API {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backup_name_template = backup-%s {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backup_use_same_host = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backup_use_temp_snapshot = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] chap_password = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88300]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] chap_username = {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cinder_internal_tenant_project_id = 874d6367a65f4c0790462050b2a6ca38 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cinder_internal_tenant_user_id = d08f2bc499524f11884695337bc27d57 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cluster = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] compression_format = gzip {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] compute_api_class = cinder.compute.nova.API {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] config_dir = [] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] config_source = [] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] control_exchange = openstack {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] debug = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] default_availability_zone = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] default_group_type = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] default_volume_type = QuobyteHD {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] disk_geometry = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] driver_client_cert = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] driver_client_cert_key = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] driver_data_namespace = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] driver_ssl_cert_path = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] driver_ssl_cert_verify = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] driver_use_ssl = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] enable_new_services = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] enable_unsupported_driver = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] enabled_backends = ['QuobyteHD'] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] enforce_multipath_for_image_xfer = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] filter_function = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance_api_insecure = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance_api_servers = ['http://192.168.122.99/image'] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance_api_ssl_compression = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance_ca_certificates_file = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance_catalog_info = image:glance:publicURL {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance_certfile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance_keyfile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance_num_retries = 3 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance_request_timeout = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] goodness_function = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] graceful_shutdown_timeout = 5 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] group_api_class = cinder.group.api.API {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] host = devstack {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] image_compress_on_upload = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] image_conversion_address_space_limit = 1 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] image_conversion_cpu_limit = 60 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] image_conversion_disable = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] image_upload_use_cinder_backend = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] image_upload_use_internal_tenant = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] image_volume_cache_enabled = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] image_volume_cache_max_count = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] image_volume_cache_max_size_gb = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] init_host_max_objects_retrieval = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] instance_format = [instance: %(uuid)s] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] iscsi_target_flags = {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] iscsi_write_cache = on {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] iser_helper = tgtadm {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] iser_ip_address = 192.168.122.99 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] iser_port = 3260 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] log_color = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] log_config_append = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] log_dir = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] log_file = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] log_options = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] log_rotate_interval = 1 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] log_rotate_interval_type = days {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] log_rotation_type = none {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] max_age = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] max_logfile_count = 30 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] max_logfile_size_mb = 200 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] max_over_subscription_ratio = 20.0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] message_reap_interval = 86400 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] message_ttl = 2592000 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] migration_create_volume_timeout_secs = 300 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] monkey_patch = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] monkey_patch_modules = [] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] my_ip = 192.168.122.99 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] no_snapshot_gb_quota = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] num_iser_scan_tries = 3 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] num_shell_tries = 3 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] num_volume_device_scan_tries = 3 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] nvmeof_conn_info_version = 1 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] nvmet_ns_id = 10 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] nvmet_port_id = 1 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] osapi_max_limit = 1000 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] osapi_volume_ext_list = [] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] osapi_volume_listen_port = 8776 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] osapi_volume_use_ssl = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] osapi_volume_workers = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] per_volume_size_limit = -1 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] periodic_fuzzy_delay = 60 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] periodic_interval = 60 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] public_endpoint = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] publish_errors = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] quota_backup_gigabytes = 1000 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] quota_backups = 10 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] quota_gigabytes = 1000 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] quota_groups = 10 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] quota_snapshots = 10 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] quota_volumes = 10 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] rate_limit_burst = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] rate_limit_except_level = CRITICAL {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] rate_limit_interval = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] reinit_driver_count = 3 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] replication_device = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] report_discard_supported = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] report_interval = 120 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] reservation_clean_interval = 86400 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] reservation_expire = 86400 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] reserved_image_namespaces = [] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] reserved_percentage = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] rpc_response_timeout = 120 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] run_external_periodic_tasks = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] scst_target_driver = iscsi {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] scst_target_iqn_name = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] service_down_time = 720 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] shell_completion = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] snapshot_name_template = snapshot-%s {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88300) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] split_loggers = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] state_path = /opt/stack/data/cinder {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] storage_availability_zone = nova {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] storage_protocol = iSCSI {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] syslog_log_facility = LOG_USER {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] target_helper = lioadm {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] target_ip_address = 192.168.122.99 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] target_port = 3260 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] target_protocol = iscsi {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] target_secondary_ip_addresses = [] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] trace_flags = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] transport_url = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] until_refresh = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] use_chap_auth = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] use_default_quota_class = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] use_journal = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] use_json = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] use_multipath_for_image_xfer = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] use_stderr = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] use_syslog = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] verify_glance_signatures = enabled {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] volume_api_class = cinder.volume.api.API {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] volume_backend_name = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] volume_clear = zero {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] volume_clear_ionice = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] volume_clear_size = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] volume_copy_bps_limit = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] volume_dd_blocksize = 1M {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] volume_name_template = volume-%s {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] volume_service_inithost_offload = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] volume_usage_audit_period = month {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] zoning_mode = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_concurrency.disable_process_locking = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.auth_section = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.auth_type = password {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.auth_version = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.cache = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.certfile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.include_service_catalog = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.insecure = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.interface = public {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.keyfile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.memcache_password = {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.memcache_username = {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.region_name = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.service_type = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.99/identity {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.backend = dogpile.cache.null {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.backend_argument = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.backend_expiration_time = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.config_prefix = cache.oslo {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.debug_cache_backend = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.enable_retry_client = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.enable_socket_keepalive = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.enabled = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.expiration_time = 600 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.hashclient_retry_attempts = 2 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.memcache_dead_retry = 300 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.memcache_pool_maxsize = 10 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.memcache_sasl_enabled = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.password = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.proxies = [] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.redis_db = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.redis_server = localhost:6379 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.retry_attempts = 2 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.retry_delay = 0.0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.socket_keepalive_count = 1 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.socket_keepalive_idle = 1 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.socket_keepalive_interval = 1 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.socket_timeout = 1.0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.tls_allowed_ciphers = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.tls_cafile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.tls_certfile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.tls_enabled = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.tls_keyfile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cache.username = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] coordination.backend_url = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.asyncio_connection = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.asyncio_slave_connection = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.backend = sqlalchemy {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.connection = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.connection_debug = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.connection_parameters = {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.connection_recycle_time = 3600 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.connection_trace = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.db_inc_retry_interval = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.db_max_retries = 20 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.db_max_retry_interval = 10 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.db_retry_interval = 1 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.max_overflow = 50 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.max_pool_size = 5 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.max_retries = 10 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.mysql_wsrep_sync_wait = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.pool_timeout = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.retry_interval = 10 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.slave_connection = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.sqlite_synchronous = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.synchronous_reader = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] database.use_db_reconnect = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] profiler.connection_string = messaging:// {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] profiler.enabled = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] profiler.es_doc_type = notification {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] profiler.es_scroll_size = 10000 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] profiler.es_scroll_time = 2m {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] profiler.filter_error_trace = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] profiler.hmac_keys = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] profiler.sentinel_service_name = mymaster {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] profiler.socket_timeout = 0.1 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] profiler.trace_requests = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] profiler.trace_sqlalchemy = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] profiler_jaeger.process_tags = {} {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] profiler_jaeger.service_name_prefix = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] profiler_otlp.service_name_prefix = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_policy.enforce_new_defaults = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_policy.enforce_scope = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_policy.policy_default_rule = default {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_policy.policy_file = policy.yaml {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] privsep_osbrick.group = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] privsep_osbrick.helper_command = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] privsep_osbrick.user = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cinder_sys_admin.group = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cinder_sys_admin.helper_command = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] cinder_sys_admin.user = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] service_user.auth_section = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] service_user.auth_type = password {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] service_user.cafile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] service_user.certfile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] service_user.collect_timing = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] service_user.insecure = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] service_user.keyfile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] service_user.send_service_user_token = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] service_user.split_loggers = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] service_user.timeout = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance.auth_section = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance.auth_type = password {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance.certfile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance.collect_timing = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance.insecure = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance.keyfile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance.region_name = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance.split_loggers = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] glance.timeout = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.backend_availability_zone = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.chap_password = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.chap_username = {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.disk_geometry = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.driver_client_cert = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.driver_client_cert_key = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.driver_data_namespace = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.driver_use_ssl = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.extra_capabilities = {} {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.filter_function = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.goodness_function = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.iscsi_target_flags = {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.iscsi_write_cache = on {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88300) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.iser_helper = tgtadm {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.quobyte [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.iser_ip_address = 192.168.122.99 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.quobyte [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.iser_port = 3260 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Running cmd (subprocess): mount.quobyte {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.nas_host = {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.nas_login = admin {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.nas_mount_options = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.nas_password = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.nas_private_key = {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.nas_share_path = {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.num_shell_tries = 3 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.quobyte_volume_url = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.replication_device = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.report_discard_supported = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.reserved_percentage = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.target_helper = tgtadm {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.target_ip_address = 192.168.122.99 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.target_port = 3260 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.target_protocol = iscsi {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.trace_flags = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.unique_fqdn_network = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.use_chap_auth = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.volume_backend_name = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.volume_clear = zero {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.volume_clear_ionice = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.volume_clear_size = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_reports.file_event_handler = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_reports.log_dir = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.backend_availability_zone = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.backend_host = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.chap_password = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.chap_username = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.chiscsi_conf = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.disk_geometry = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.driver_client_cert = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.driver_data_namespace = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.driver_use_ssl = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.extra_capabilities = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.filter_function = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.goodness_function = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.iser_helper = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.iser_ip_address = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.iser_port = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.iser_target_prefix = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.nas_host = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.nas_login = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.nas_mount_options = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.nas_password = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.nas_private_key = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.nas_share_path = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.nas_ssh_port = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.num_shell_tries = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.nvmet_port_id = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.replication_device = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.report_discard_supported = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.reserved_percentage = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.scst_target_driver = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.storage_protocol = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.target_helper = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.target_ip_address = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.target_port = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.target_prefix = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.target_protocol = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.trace_flags = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.use_chap_auth = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.volume_clear = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.volume_clear_size = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] QuobyteHD.volumes_dir = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.ssl = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_notifications.driver = [] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_notifications.retry = -1 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] key_manager.fixed_key = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican.barbican_api_version = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican.barbican_endpoint = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican.barbican_endpoint_type = public {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican.barbican_region_name = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican.cafile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican.certfile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican.collect_timing = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican.insecure = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican.keyfile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican.number_of_retries = 60 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican.retry_delay = 1 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican.send_service_user_token = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican.split_loggers = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican.timeout = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican.verify_ssl = True {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican.verify_ssl_path = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican_service_user.auth_section = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican_service_user.auth_type = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican_service_user.cafile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican_service_user.certfile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican_service_user.collect_timing = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican_service_user.insecure = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican_service_user.keyfile = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican_service_user.split_loggers = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] barbican_service_user.timeout = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] vault.approle_role_id = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] vault.approle_secret_id = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] vault.auth_method = approle {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] vault.auth_path = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] vault.kv_mountpoint = secret {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] vault.kv_path = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] vault.kv_version = 2 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] vault.namespace = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] vault.root_token_id = **** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] vault.ssl_ca_crt_file = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] vault.timeout = 60.0 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] vault.token_file = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] vault.token_role = None {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] vault.use_ssl = False {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 14 21:13:31 devstack cinder-volume[88012]: DEBUG oslo_service.backend._eventlet.service [None req-0680fb17-9eb0-4572-99fa-b1233ad8bb03 None None] ******************************************************************************** {{(pid=88012) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 14 21:13:31 devstack quobyte-client[88312]: Reading configuration file: /etc/quobyte/client.cfg Jul 14 21:13:31 devstack quobyte-client[88312]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] CMD "mount.quobyte" returned: 1 in 0.099s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:13:31 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:13:31 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:13:31 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.252s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:13:31 devstack cinder-volume[88300]: INFO cinder.volume.driver [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Driver hasn't implemented _init_vendor_properties() Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG cinder.volume.driver [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88300) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG oslo_db.sqlalchemy.engines [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88300) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writer thread running {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG cinder.db.api [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Building query based on filter {{(pid=88300) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88300) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:13:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:13:31 devstack cinder-volume[88300]: INFO cinder.keymgr.migration [None req-e6391fe9-01c1-4928-a343-4f97a9d2e6d8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 14 21:13:31 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:13:31 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:13:32 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Jul 14 21:13:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.232s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:13:32 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:13:32 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Driver initialization completed successfully. Jul 14 21:13:32 devstack cinder-volume[88300]: INFO cinder.manager [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Initiating service 3 cleanup Jul 14 21:13:32 devstack cinder-volume[88300]: INFO cinder.manager [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Service 3 cleanup completed. Jul 14 21:13:32 devstack cinder-volume[88300]: DEBUG cinder.service [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Creating RPC server for service cinder-volume {{(pid=88300) start /opt/stack/cinder/cinder/service.py:231}} Jul 14 21:13:32 devstack cinder-volume[88300]: DEBUG cinder.service [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88300) start /opt/stack/cinder/cinder/service.py:237}} Jul 14 21:13:32 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 14 21:13:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:13:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:13:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:13:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:13:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:13:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:13:32 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:13:32 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:13:32 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Jul 14 21:13:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.234s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:13:32 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0da557c0-96c0-464a-8353-ef6aa40592d1 None None] Driver post RPC initialization completed successfully. Jul 14 21:13:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:13:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 6 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:13:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:13:41 devstack cinder-volume[88012]: DEBUG dbcounter [-] [88012] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:13:42 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=2 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:13:42 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:14:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:14:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:14:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:14:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:14:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:14:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:14:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:14:36 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:14:36 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:14:37 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Jul 14 21:14:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.565s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:14:37 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:14:37 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:14:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 6 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:14:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Flow 'volume_create_manager' (7fd7a2c2-7349-4e54-9224-1f613e78b591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34235dd-4266-4514-8854-80d56a6462af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34235dd-4266-4514-8854-80d56a6462af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1782530347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d9b6fc-4fe8-450b-88d9-71d47e9ea25b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb1c789fab9473a83609fdf4603afd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:14:59Z,use_quota=True,user_id='fbe8d880941248259ed5a46924e26825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d9e1fb-f02f-4b7b-bbc1-7ca5cea9564e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d9e1fb-f02f-4b7b-bbc1-7ca5cea9564e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf1dbf4-005b-4bae-8c62-334c095febda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf1dbf4-005b-4bae-8c62-334c095febda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09d9b6fc-4fe8-450b-88d9-71d47e9ea25b', 'volume_name': 'volume-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7831624c-cd50-4bc9-a2db-eae0f8cb7017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7831624c-cd50-4bc9-a2db-eae0f8cb7017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe68c14-7308-452d-a4fe-7efd4da422cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:14:59 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Volume 09d9b6fc-4fe8-450b-88d9-71d47e9ea25b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b', 'volume_size': 1} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1782530347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d9b6fc-4fe8-450b-88d9-71d47e9ea25b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb1c789fab9473a83609fdf4603afd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:14:59Z,use_quota=True,user_id='fbe8d880941248259ed5a46924e26825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Creating volume 09d9b6fc-4fe8-450b-88d9-71d47e9ea25b {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:14:59 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:14:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:14:59 devstack sudo[89191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b 1073741824 Jul 14 21:14:59 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:00 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b 1073741824" returned: 0 in 1.144s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:01 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b Jul 14 21:15:01 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:01 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b" returned: 0 in 0.432s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:15:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe68c14-7308-452d-a4fe-7efd4da422cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d372d55-adc6-41e4-971b-65f6719bcaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:01 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Volume volume-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b (09d9b6fc-4fe8-450b-88d9-71d47e9ea25b): created successfully Jul 14 21:15:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d372d55-adc6-41e4-971b-65f6719bcaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Flow 'volume_create_manager' (7fd7a2c2-7349-4e54-9224-1f613e78b591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:15:01 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d22297f5-c25a-49d5-a13b-3b9ef4aa5d62 tempest-VolumesAdminNegativeTest-701503439 None] Created volume successfully. Jul 14 21:15:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Acquiring lock "cinder-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:15:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Lock "cinder-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:15:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Acquiring lock "cinder-quobyte-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:15:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Lock "cinder-quobyte-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b" acquired by "delete_volume" :: waited 0.030s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:15:03 devstack cinder-volume[88300]: INFO oslo.privsep.daemon [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpb1e45q74/privsep.sock'] Jul 14 21:15:03 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpb1e45q74/privsep.sock Jul 14 21:15:03 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Flow 'volume_create_manager' (f6c3a097-f7c0-4189-88aa-871642229198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93628da9-2923-48f4-a8ab-337267e3f930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93628da9-2923-48f4-a8ab-337267e3f930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-544244098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e040da-e31f-4d7b-9eb5-2c0caed8700f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7eb23d61ffc42a4b144a4ec63f1eb77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:15:05Z,use_quota=True,user_id='9340bc93cf134834a4effb9b82d08973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8bf445-9477-4c27-94ba-d3b49cf80aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8bf445-9477-4c27-94ba-d3b49cf80aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5a38e0-08fe-4c26-b98b-dbca7d4ca6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5a38e0-08fe-4c26-b98b-dbca7d4ca6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3e040da-e31f-4d7b-9eb5-2c0caed8700f', 'volume_name': 'volume-e3e040da-e31f-4d7b-9eb5-2c0caed8700f', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059ea0cb-e78e-4c5a-ad9d-fb628752399b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059ea0cb-e78e-4c5a-ad9d-fb628752399b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c85481-2cf8-413e-8626-d6a439d84b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:05 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Volume e3e040da-e31f-4d7b-9eb5-2c0caed8700f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3e040da-e31f-4d7b-9eb5-2c0caed8700f', 'volume_size': 1} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-544244098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e040da-e31f-4d7b-9eb5-2c0caed8700f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7eb23d61ffc42a4b144a4ec63f1eb77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:15:05Z,use_quota=True,user_id='9340bc93cf134834a4effb9b82d08973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Creating volume e3e040da-e31f-4d7b-9eb5-2c0caed8700f {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:15:05 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e3e040da-e31f-4d7b-9eb5-2c0caed8700f 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:05 devstack cinder-volume[88300]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 14 21:15:05 devstack cinder-volume[88300]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 14 21:15:05 devstack cinder-volume[88300]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 14 21:15:05 devstack cinder-volume[88300]: WARNING oslo.privsep.daemon [-] privsep log: Jul 14 21:15:05 devstack cinder-volume[88300]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 14 21:15:05 devstack cinder-volume[88300]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 14 21:15:05 devstack cinder-volume[88300]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 14 21:15:05 devstack cinder-volume[88300]: WARNING oslo.privsep.daemon [-] privsep log: Jul 14 21:15:05 devstack cinder-volume[88300]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 14 21:15:05 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e3e040da-e31f-4d7b-9eb5-2c0caed8700f 1073741824 Jul 14 21:15:05 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Flow 'volume_create_manager' (3188d860-cd3b-4ef0-8930-ade0b0671ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5852d6-06f4-4f64-9ea2-bf4e2fa57f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5852d6-06f4-4f64-9ea2-bf4e2fa57f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1187802770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172988b0-c1ee-40d0-b500-854adaa18137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef6aff670d482696f5dd7e8d841e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:15:05Z,use_quota=True,user_id='9a91e9b451064f698e6904f56e6fa59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d411eca-88ee-4a3f-9c14-e0c53742e986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d411eca-88ee-4a3f-9c14-e0c53742e986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5792a9b-0a82-4243-902c-eb22e83d0c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5792a9b-0a82-4243-902c-eb22e83d0c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '172988b0-c1ee-40d0-b500-854adaa18137', 'volume_name': 'volume-172988b0-c1ee-40d0-b500-854adaa18137', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21564cc4-24e6-4851-b7eb-11426b8267ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21564cc4-24e6-4851-b7eb-11426b8267ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2db6e1-ae31-473f-9853-93a76e2f12b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:05 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Volume 172988b0-c1ee-40d0-b500-854adaa18137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-172988b0-c1ee-40d0-b500-854adaa18137', 'volume_size': 1} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:05 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:05 devstack cinder-volume[88300]: INFO oslo.privsep.daemon [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Spawned new privsep daemon via rootwrap Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Accepted privsep connection to /tmp/tmpb1e45q74/privsep.sock {{(pid=88300) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 14 21:15:05 devstack cinder-volume[88300]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 14 21:15:05 devstack cinder-volume[88300]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 14 21:15:05 devstack cinder-volume[88300]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 14 21:15:05 devstack cinder-volume[88300]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89528 Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[212baeb5-d857-4711-a224-e24c192f7127]: (2,) {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37411aa-a904-48d0-a0f9-5ec52a0a2bf0]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:15:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:06 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b Jul 14 21:15:06 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:06 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e3e040da-e31f-4d7b-9eb5-2c0caed8700f 1073741824" returned: 0 in 0.791s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e3e040da-e31f-4d7b-9eb5-2c0caed8700f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:06 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e3e040da-e31f-4d7b-9eb5-2c0caed8700f Jul 14 21:15:06 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:06 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b" returned: 0 in 0.553s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:06 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b Jul 14 21:15:06 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:06 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e3e040da-e31f-4d7b-9eb5-2c0caed8700f" returned: 0 in 0.500s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.922s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1187802770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172988b0-c1ee-40d0-b500-854adaa18137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fef6aff670d482696f5dd7e8d841e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:15:05Z,use_quota=True,user_id='9a91e9b451064f698e6904f56e6fa59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Creating volume 172988b0-c1ee-40d0-b500-854adaa18137 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:15:06 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:06 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137 1073741824 Jul 14 21:15:06 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c85481-2cf8-413e-8626-d6a439d84b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3e040da-e31f-4d7b-9eb5-2c0caed8700f', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0a7139-4c05-4334-bea0-8b1b6b6c4da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:06 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b" returned: 0 in 0.387s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:06 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Volume volume-e3e040da-e31f-4d7b-9eb5-2c0caed8700f (e3e040da-e31f-4d7b-9eb5-2c0caed8700f): created successfully Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0a7139-4c05-4334-bea0-8b1b6b6c4da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Flow 'volume_create_manager' (f6c3a097-f7c0-4189-88aa-871642229198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:15:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Lock "cinder-quobyte-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b" released by "delete_volume" :: held 3.366s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:15:06 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-5df20cd9-b597-424f-90bf-9bb778aa4fc2 tempest-ServersNegativeTestJSON-85698686 None] Created volume successfully. Jul 14 21:15:07 devstack cinder-volume[88300]: WARNING cinder.quota [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:15:07 devstack cinder-volume[88300]: WARNING cinder.quota [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:15:07 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Created reservations ['d94ba718-4ab4-4c74-af62-78fe35a7ddbc', '0e218e64-895b-48f8-9d23-8bf7d66518dc', 'fd294e7c-7272-49bb-8939-aded1014ccf6', '810b8377-ef19-4cdf-b4fc-9ea21487b443'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:15:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:15:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:15:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:07 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:15:07 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:07 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137 1073741824" returned: 0 in 0.787s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:07 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137 Jul 14 21:15:07 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:07 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.523s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:07 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:15:07 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Deleted volume successfully. Jul 14 21:15:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d187ea84-e40e-4a3e-a1e5-9ff6738c8aaf tempest-VolumesAdminNegativeTest-701503439 None] Lock "cinder-09d9b6fc-4fe8-450b-88d9-71d47e9ea25b-delete_volume" released by "delete_volume" :: held 4.436s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:15:08 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137" returned: 0 in 0.476s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:08 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:15:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2db6e1-ae31-473f-9853-93a76e2f12b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-172988b0-c1ee-40d0-b500-854adaa18137', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f3875a-da4c-40d6-987a-a4ee28ae3052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:08 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Volume volume-172988b0-c1ee-40d0-b500-854adaa18137 (172988b0-c1ee-40d0-b500-854adaa18137): created successfully Jul 14 21:15:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f3875a-da4c-40d6-987a-a4ee28ae3052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Flow 'volume_create_manager' (3188d860-cd3b-4ef0-8930-ade0b0671ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:15:08 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-654b152e-694a-4311-97b2-13ace9351a84 tempest-ServerActionsTestOtherA-1179246485 None] Created volume successfully. Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Flow 'volume_create_manager' (05b6217a-456c-4667-875c-b715e52447e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2bb8219-3934-4ae3-92b5-99777859ec09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2bb8219-3934-4ae3-92b5-99777859ec09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-458565707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91aab1e-d25f-4889-9cfe-7edc1469f10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7eb23d61ffc42a4b144a4ec63f1eb77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:15:11Z,use_quota=True,user_id='9340bc93cf134834a4effb9b82d08973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac7bb343-ff1f-42de-98aa-4499c631c38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac7bb343-ff1f-42de-98aa-4499c631c38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b050ddd-8abc-46f3-a480-d6d6430c297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b050ddd-8abc-46f3-a480-d6d6430c297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91aab1e-d25f-4889-9cfe-7edc1469f10d', 'volume_name': 'volume-c91aab1e-d25f-4889-9cfe-7edc1469f10d', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf58a8ec-3f83-4b10-9e33-2d5f509fd8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf58a8ec-3f83-4b10-9e33-2d5f509fd8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (240345ad-5a7b-4a12-8cf9-3b4538040ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:11 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Volume c91aab1e-d25f-4889-9cfe-7edc1469f10d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91aab1e-d25f-4889-9cfe-7edc1469f10d', 'volume_size': 1} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-458565707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91aab1e-d25f-4889-9cfe-7edc1469f10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7eb23d61ffc42a4b144a4ec63f1eb77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:15:11Z,use_quota=True,user_id='9340bc93cf134834a4effb9b82d08973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Creating volume c91aab1e-d25f-4889-9cfe-7edc1469f10d {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:15:11 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c91aab1e-d25f-4889-9cfe-7edc1469f10d 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:11 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c91aab1e-d25f-4889-9cfe-7edc1469f10d 1073741824 Jul 14 21:15:11 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:11 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c91aab1e-d25f-4889-9cfe-7edc1469f10d 1073741824" returned: 0 in 0.577s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c91aab1e-d25f-4889-9cfe-7edc1469f10d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:12 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c91aab1e-d25f-4889-9cfe-7edc1469f10d Jul 14 21:15:12 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:12 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c91aab1e-d25f-4889-9cfe-7edc1469f10d" returned: 0 in 0.338s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:15:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (240345ad-5a7b-4a12-8cf9-3b4538040ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91aab1e-d25f-4889-9cfe-7edc1469f10d', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68273e3a-f665-40aa-8be9-c71c02c94bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:12 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Volume volume-c91aab1e-d25f-4889-9cfe-7edc1469f10d (c91aab1e-d25f-4889-9cfe-7edc1469f10d): created successfully Jul 14 21:15:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68273e3a-f665-40aa-8be9-c71c02c94bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Flow 'volume_create_manager' (05b6217a-456c-4667-875c-b715e52447e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:15:12 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-450f51c7-aa1e-43e8-a183-7d559c8f08d4 tempest-ServersNegativeTestJSON-85698686 None] Created volume successfully. Jul 14 21:15:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] Acquiring lock "cinder-c91aab1e-d25f-4889-9cfe-7edc1469f10d-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:15:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] Lock "cinder-c91aab1e-d25f-4889-9cfe-7edc1469f10d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:15:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] Acquiring lock "cinder-quobyte-c91aab1e-d25f-4889-9cfe-7edc1469f10d" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:15:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] Lock "cinder-quobyte-c91aab1e-d25f-4889-9cfe-7edc1469f10d" acquired by "delete_volume" :: waited 0.022s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:15:15 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28fc5de-5f15-4fc4-9cc4-4cd3828c7020]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:15:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c91aab1e-d25f-4889-9cfe-7edc1469f10d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:15 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c91aab1e-d25f-4889-9cfe-7edc1469f10d Jul 14 21:15:15 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:16 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c91aab1e-d25f-4889-9cfe-7edc1469f10d" returned: 0 in 0.459s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c91aab1e-d25f-4889-9cfe-7edc1469f10d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:16 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c91aab1e-d25f-4889-9cfe-7edc1469f10d Jul 14 21:15:16 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:16 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c91aab1e-d25f-4889-9cfe-7edc1469f10d" returned: 0 in 0.305s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] Lock "cinder-quobyte-c91aab1e-d25f-4889-9cfe-7edc1469f10d" released by "delete_volume" :: held 0.813s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:15:16 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] Created reservations ['3bd8ff4d-9349-4a02-bf2c-dcc9ddc2ae90', '342a1d9e-db2e-4431-bc31-bc12f0795165', '3ccf6bde-7769-4a8f-baa2-52b779b7b8f8', 'dfe86928-fa97-4b56-8def-ca201c67ecca'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:15:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:15:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:15:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:16 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:15:16 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] Acquiring lock "cinder-e3e040da-e31f-4d7b-9eb5-2c0caed8700f-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:15:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] Lock "cinder-e3e040da-e31f-4d7b-9eb5-2c0caed8700f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:15:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] Acquiring lock "cinder-quobyte-e3e040da-e31f-4d7b-9eb5-2c0caed8700f" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:15:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] Lock "cinder-quobyte-e3e040da-e31f-4d7b-9eb5-2c0caed8700f" acquired by "delete_volume" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:15:17 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8a1aaa-e0e3-4699-9977-cdb00d4d9633]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:15:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e3e040da-e31f-4d7b-9eb5-2c0caed8700f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:17 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.407s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:17 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:15:17 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] Deleted volume successfully. Jul 14 21:15:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-839d8f6e-79a8-44c7-a339-60797596e527 tempest-ServersNegativeTestJSON-85698686 None] Lock "cinder-c91aab1e-d25f-4889-9cfe-7edc1469f10d-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:15:17 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e3e040da-e31f-4d7b-9eb5-2c0caed8700f Jul 14 21:15:17 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:17 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e3e040da-e31f-4d7b-9eb5-2c0caed8700f" returned: 0 in 0.508s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e3e040da-e31f-4d7b-9eb5-2c0caed8700f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:17 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e3e040da-e31f-4d7b-9eb5-2c0caed8700f Jul 14 21:15:17 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:17 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e3e040da-e31f-4d7b-9eb5-2c0caed8700f" returned: 0 in 0.278s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] Lock "cinder-quobyte-e3e040da-e31f-4d7b-9eb5-2c0caed8700f" released by "delete_volume" :: held 0.845s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:15:18 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] Created reservations ['4772253a-d5d2-4409-8b38-e813e7687233', 'acf9f2ce-b4c6-4775-8358-1ea4339e6f97', '410dd199-9130-43a4-a447-2ee1fd0fa9bd', '405cf65f-d371-4fd2-a9e6-a5c0c3c3e7b5'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:15:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:15:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:15:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:18 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:15:18 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:18 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.388s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:18 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:15:18 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] Deleted volume successfully. Jul 14 21:15:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e808e775-5338-4142-8b28-d64458791109 tempest-ServersNegativeTestJSON-85698686 None] Lock "cinder-e3e040da-e31f-4d7b-9eb5-2c0caed8700f-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:15:28 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=20,cinder:UPDATE=39,cinder:DELETE=4,cinder:INSERT=7 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:15:28 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=26,cinder:UPDATE=33,cinder:INSERT=9,cinder:DELETE=3 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:15:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:15:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:15:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:15:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:36 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:15:36 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:37 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.494s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:37 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:15:37 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:15:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 8 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:15:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Flow 'volume_create_manager' (4123583f-a04b-42f0-8edc-1ecd0345c46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c7d273-f02c-420d-9b0b-9b51327f17a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c7d273-f02c-420d-9b0b-9b51327f17a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-46956038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27976b72-5a5b-4c44-96bb-8a13d09e9551,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8e354d660ac41b5849f709ac1c145c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:15:38Z,use_quota=True,user_id='06a2d83a75354d46a68a54e4aed17598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7254c8a7-7f44-4faa-936c-69cfc47b98b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7254c8a7-7f44-4faa-936c-69cfc47b98b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83e2622-784d-41f3-9b19-7c3227295d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83e2622-784d-41f3-9b19-7c3227295d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27976b72-5a5b-4c44-96bb-8a13d09e9551', 'volume_name': 'volume-27976b72-5a5b-4c44-96bb-8a13d09e9551', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566c1ab9-3c12-4f18-a8a5-1b8a8e807f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566c1ab9-3c12-4f18-a8a5-1b8a8e807f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff16712-bd44-4eea-8138-014e1508dd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:38 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Volume 27976b72-5a5b-4c44-96bb-8a13d09e9551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27976b72-5a5b-4c44-96bb-8a13d09e9551', 'volume_size': 1} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-46956038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27976b72-5a5b-4c44-96bb-8a13d09e9551,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8e354d660ac41b5849f709ac1c145c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:15:38Z,use_quota=True,user_id='06a2d83a75354d46a68a54e4aed17598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Creating volume 27976b72-5a5b-4c44-96bb-8a13d09e9551 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:15:38 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-27976b72-5a5b-4c44-96bb-8a13d09e9551 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:15:38 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-27976b72-5a5b-4c44-96bb-8a13d09e9551 1073741824 Jul 14 21:15:38 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Flow 'volume_create_manager' (34663ca8-5443-4b48-a6c9-462c963a58a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28143cea-4381-4087-ad5e-07e370140b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28143cea-4381-4087-ad5e-07e370140b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2143265373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada766cb-000d-4b7f-85ce-e34ce5d9ab20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513fa24abfdc4442a9b6d8f2fab52a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:15:39Z,use_quota=True,user_id='69fe6f49a5164f4b929c2fd7696998d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181507e7-f385-48f7-a6df-9fbe6e08ddce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181507e7-f385-48f7-a6df-9fbe6e08ddce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b5c651-c4a3-4e81-a8b6-7a1f8c3eda27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b5c651-c4a3-4e81-a8b6-7a1f8c3eda27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada766cb-000d-4b7f-85ce-e34ce5d9ab20', 'volume_name': 'volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ca02be-310f-4100-b9f9-04097cb0aed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ca02be-310f-4100-b9f9-04097cb0aed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee584956-f028-4b42-9e59-9b024bd15959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:38 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Volume ada766cb-000d-4b7f-85ce-e34ce5d9ab20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20', 'volume_size': 1} Jul 14 21:15:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:39 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-27976b72-5a5b-4c44-96bb-8a13d09e9551 1073741824" returned: 0 in 0.501s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-27976b72-5a5b-4c44-96bb-8a13d09e9551 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:39 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-27976b72-5a5b-4c44-96bb-8a13d09e9551 Jul 14 21:15:39 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:39 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-27976b72-5a5b-4c44-96bb-8a13d09e9551" returned: 0 in 0.298s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.732s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2143265373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada766cb-000d-4b7f-85ce-e34ce5d9ab20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513fa24abfdc4442a9b6d8f2fab52a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:15:39Z,use_quota=True,user_id='69fe6f49a5164f4b929c2fd7696998d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Creating volume ada766cb-000d-4b7f-85ce-e34ce5d9ab20 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:15:39 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:39 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20 1073741824 Jul 14 21:15:39 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff16712-bd44-4eea-8138-014e1508dd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27976b72-5a5b-4c44-96bb-8a13d09e9551', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19d167e-37a8-49a8-a1b6-3b970a73a51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:39 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Volume volume-27976b72-5a5b-4c44-96bb-8a13d09e9551 (27976b72-5a5b-4c44-96bb-8a13d09e9551): created successfully Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19d167e-37a8-49a8-a1b6-3b970a73a51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Flow 'volume_create_manager' (4123583f-a04b-42f0-8edc-1ecd0345c46f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:15:39 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-69ca95ef-b025-4ef1-9b79-335f9e5cb007 req-ba27eb04-ed7f-404c-95b2-3a4103266a19 tempest-VolumesGetTestJSON-842533852 None] Created volume successfully. Jul 14 21:15:40 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20 1073741824" returned: 0 in 0.537s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:40 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20 Jul 14 21:15:40 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:40 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20" returned: 0 in 0.320s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:40 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:15:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee584956-f028-4b42-9e59-9b024bd15959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf937763-48c8-4171-9d5d-1b8ea24fec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:40 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Volume volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20 (ada766cb-000d-4b7f-85ce-e34ce5d9ab20): created successfully Jul 14 21:15:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf937763-48c8-4171-9d5d-1b8ea24fec3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Flow 'volume_create_manager' (34663ca8-5443-4b48-a6c9-462c963a58a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:15:40 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-769df1aa-35c8-4db0-8098-952dc886ef8c tempest-DeleteServersTestJSON-238276077 None] Created volume successfully. Jul 14 21:15:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] Acquiring lock "cinder-27976b72-5a5b-4c44-96bb-8a13d09e9551-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:15:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] Lock "cinder-27976b72-5a5b-4c44-96bb-8a13d09e9551-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:15:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] Acquiring lock "cinder-quobyte-27976b72-5a5b-4c44-96bb-8a13d09e9551" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:15:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] Lock "cinder-quobyte-27976b72-5a5b-4c44-96bb-8a13d09e9551" acquired by "delete_volume" :: waited 0.022s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:15:41 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5841df1-bfdd-4682-a2db-c7f8d8307ae3]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:15:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-27976b72-5a5b-4c44-96bb-8a13d09e9551 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:41 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-27976b72-5a5b-4c44-96bb-8a13d09e9551 Jul 14 21:15:41 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:41 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-27976b72-5a5b-4c44-96bb-8a13d09e9551" returned: 0 in 0.355s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-27976b72-5a5b-4c44-96bb-8a13d09e9551 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:41 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-27976b72-5a5b-4c44-96bb-8a13d09e9551 Jul 14 21:15:41 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:41 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-27976b72-5a5b-4c44-96bb-8a13d09e9551" returned: 0 in 0.358s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] Lock "cinder-quobyte-27976b72-5a5b-4c44-96bb-8a13d09e9551" released by "delete_volume" :: held 0.765s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:15:41 devstack cinder-volume[88300]: DEBUG cinder.quota [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] Created reservations ['894e6f0d-1681-49ad-98b4-500b929974fc', '234f0c90-0643-4f04-b86b-728f0348a10a', '7ff1f9a5-e4c8-4eb1-a927-69f6d51df29c', '7ac9a485-d37a-4ee6-b46c-12a970033973'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:15:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:15:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:15:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:41 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:15:41 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:42 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.319s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:42 devstack cinder-volume[88300]: DEBUG cinder.manager [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:15:42 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] Deleted volume successfully. Jul 14 21:15:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-e225db1a-044d-4787-ad19-13b71ad814cb req-831045e0-6de8-4574-b492-b4cc447ab0cd tempest-VolumesGetTestJSON-842533852 None] Lock "cinder-27976b72-5a5b-4c44-96bb-8a13d09e9551-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:15:45 devstack cinder-volume[88300]: WARNING py.warnings [req-b6568fcc-64ce-413d-8cc0-14ce0012d38f req-6b092559-0a4c-445f-ad8e-6b8a0652d312 tempest-DeleteServersTestJSON-238276077 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 14 21:15:45 devstack cinder-volume[88300]: .first() Jul 14 21:15:45 devstack cinder-volume[88300]: Jul 14 21:15:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-b6568fcc-64ce-413d-8cc0-14ce0012d38f req-6b092559-0a4c-445f-ad8e-6b8a0652d312 tempest-DeleteServersTestJSON-238276077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-b6568fcc-64ce-413d-8cc0-14ce0012d38f req-6b092559-0a4c-445f-ad8e-6b8a0652d312 tempest-DeleteServersTestJSON-238276077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:46 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e609b882-f095-4664-9288-79cb9e48212d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:15:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-b6568fcc-64ce-413d-8cc0-14ce0012d38f req-6b092559-0a4c-445f-ad8e-6b8a0652d312 tempest-DeleteServersTestJSON-238276077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:46 devstack sudo[89977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20 Jul 14 21:15:46 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:46 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-b6568fcc-64ce-413d-8cc0-14ce0012d38f req-6b092559-0a4c-445f-ad8e-6b8a0652d312 tempest-DeleteServersTestJSON-238276077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20" returned: 0 in 0.536s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-b6568fcc-64ce-413d-8cc0-14ce0012d38f req-6b092559-0a4c-445f-ad8e-6b8a0652d312 tempest-DeleteServersTestJSON-238276077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.590s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:46 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-b6568fcc-64ce-413d-8cc0-14ce0012d38f req-6b092559-0a4c-445f-ad8e-6b8a0652d312 tempest-DeleteServersTestJSON-238276077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1938adf5-31e2-4516-9df5-1236afab973c', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:15:46 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-b6568fcc-64ce-413d-8cc0-14ce0012d38f req-6b092559-0a4c-445f-ad8e-6b8a0652d312 tempest-DeleteServersTestJSON-238276077 None] attachment_update completed successfully. Jul 14 21:15:48 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e38cc6f2-512b-40ec-9bdc-9d9ea6c77eca tempest-GroupSnapshotsV319Test-1981215360 None] Group tempest-GroupSnapshotsV319Test-Group-133975336: creating Jul 14 21:15:48 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e38cc6f2-512b-40ec-9bdc-9d9ea6c77eca tempest-GroupSnapshotsV319Test-1981215360 None] Group tempest-GroupSnapshotsV319Test-Group-133975336: created successfully Jul 14 21:15:48 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e38cc6f2-512b-40ec-9bdc-9d9ea6c77eca tempest-GroupSnapshotsV319Test-1981215360 None] Create group completed successfully. Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Flow 'volume_create_manager' (693a88f2-e270-4bd3-a129-e6831a5bf418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762d3074-e44e-4906-a145-434c211b8500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762d3074-e44e-4906-a145-434c211b8500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1502561924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=606d94bf-0fb4-45fa-b04f-29fee8b96808,host='devstack@QuobyteHD#QuobyteHD',id=74ecd03b-e1e9-4927-b86e-76559a0244ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef611b17151b494587120fc9c9a67cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:15:51Z,use_quota=True,user_id='3efe590b81174527bfc36af719242ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(defa2efb-7a83-4e5a-b441-96a95e296b32),volume_type_id=defa2efb-7a83-4e5a-b441-96a95e296b32)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aed5576-e42a-4857-b005-aec099e7ff08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aed5576-e42a-4857-b005-aec099e7ff08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc76d0b-357d-4e8a-a9b1-b7b87b4b9f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc76d0b-357d-4e8a-a9b1-b7b87b4b9f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74ecd03b-e1e9-4927-b86e-76559a0244ce', 'volume_name': 'volume-74ecd03b-e1e9-4927-b86e-76559a0244ce', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4b687a-57b3-4adc-98ca-b0f67d0d1490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4b687a-57b3-4adc-98ca-b0f67d0d1490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb89c74-49a7-43e7-8877-2590ea6750cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:50 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Volume 74ecd03b-e1e9-4927-b86e-76559a0244ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74ecd03b-e1e9-4927-b86e-76559a0244ce', 'volume_size': 1} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=606d94bf-0fb4-45fa-b04f-29fee8b96808,created_at=2026-07-14T19:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1502561924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=606d94bf-0fb4-45fa-b04f-29fee8b96808,host='devstack@QuobyteHD#QuobyteHD',id=74ecd03b-e1e9-4927-b86e-76559a0244ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef611b17151b494587120fc9c9a67cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:15:51Z,use_quota=True,user_id='3efe590b81174527bfc36af719242ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(defa2efb-7a83-4e5a-b441-96a95e296b32),volume_type_id=defa2efb-7a83-4e5a-b441-96a95e296b32)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Creating volume 74ecd03b-e1e9-4927-b86e-76559a0244ce {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:15:50 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:15:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:50 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce 1073741824 Jul 14 21:15:50 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:51 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce 1073741824" returned: 0 in 0.566s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:51 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce Jul 14 21:15:51 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:51 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-39c057bb-85f1-4fe5-af0c-6c0ed7d86909 req-7d3e477f-dcf5-415b-906e-2e034caed624 tempest-DeleteServersTestJSON-238276077 None] Terminate volume connection completed successfully. Jul 14 21:15:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-39c057bb-85f1-4fe5-af0c-6c0ed7d86909 req-7d3e477f-dcf5-415b-906e-2e034caed624 tempest-DeleteServersTestJSON-238276077 None] Deleting attachment 1938adf5-31e2-4516-9df5-1236afab973c. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:15:51 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce" returned: 0 in 0.308s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:15:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb89c74-49a7-43e7-8877-2590ea6750cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74ecd03b-e1e9-4927-b86e-76559a0244ce', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31fb361-0e0a-484d-9681-e37707a27ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:15:51 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Volume volume-74ecd03b-e1e9-4927-b86e-76559a0244ce (74ecd03b-e1e9-4927-b86e-76559a0244ce): created successfully Jul 14 21:15:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31fb361-0e0a-484d-9681-e37707a27ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:15:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Flow 'volume_create_manager' (693a88f2-e270-4bd3-a129-e6831a5bf418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:15:51 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-46a5923c-4c79-4f7b-aafd-2b9a23456ae2 tempest-GroupSnapshotsV319Test-1981215360 None] Created volume successfully. Jul 14 21:15:52 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] GroupSnapshot 848adbe7-19c1-4cae-928c-d26b609f02f2: creating. Jul 14 21:15:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] Group snapshot 848adbe7-19c1-4cae-928c-d26b609f02f2: creating. {{(pid=88300) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 14 21:15:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] Creating offline snapshot 316740a3-4879-4344-8416-5cb054bcba55 of volume 74ecd03b-e1e9-4927-b86e-76559a0244ce {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:15:52 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb35d666-5c32-4204-9645-2911b68c27ad]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:15:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:52 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce Jul 14 21:15:52 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] Acquiring lock "cinder-ada766cb-000d-4b7f-85ce-e34ce5d9ab20-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:15:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] Lock "cinder-ada766cb-000d-4b7f-85ce-e34ce5d9ab20-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:15:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] Acquiring lock "cinder-quobyte-ada766cb-000d-4b7f-85ce-e34ce5d9ab20" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:15:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] Lock "cinder-quobyte-ada766cb-000d-4b7f-85ce-e34ce5d9ab20" acquired by "delete_volume" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:15:53 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:53 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc0c4df-18b8-468c-bc19-a0758e9cdbce]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:15:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce" returned: 0 in 0.551s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:53 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55 1G Jul 14 21:15:53 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:53 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20 Jul 14 21:15:53 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:53 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20" returned: 0 in 0.428s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:53 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20 Jul 14 21:15:53 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:53 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55 1G" returned: 0 in 0.555s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74ecd03b-e1e9-4927-b86e-76559a0244ce -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:53 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74ecd03b-e1e9-4927-b86e-76559a0244ce -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55 Jul 14 21:15:53 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:53 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ada766cb-000d-4b7f-85ce-e34ce5d9ab20" returned: 0 in 0.325s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] Lock "cinder-quobyte-ada766cb-000d-4b7f-85ce-e34ce5d9ab20" released by "delete_volume" :: held 0.821s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:15:53 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] Created reservations ['f046b556-ec2f-4465-b3c7-80d16c2324d9', 'f9e75e89-cb9c-45ed-8186-dcf19eaa3729', '77361e17-e409-4b3e-a7db-e26ee03b63d6', '97042493-aff3-43be-9b2c-8e38d33ba53e'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:15:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:15:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:15:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:54 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74ecd03b-e1e9-4927-b86e-76559a0244ce -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55" returned: 0 in 0.435s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:54 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 21:15:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:54 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:15:54 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:54 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55 Jul 14 21:15:54 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:54 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.297s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:54 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:15:54 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] Deleted volume successfully. Jul 14 21:15:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-569bfbca-02ab-4df6-b647-1af9b63581b5 tempest-DeleteServersTestJSON-238276077 None] Lock "cinder-ada766cb-000d-4b7f-85ce-e34ce5d9ab20-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:15:54 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55" returned: 0 in 0.399s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:54 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.info Jul 14 21:15:54 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:54 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.info" returned: 0 in 0.347s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:54 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 21:15:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:54 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.info Jul 14 21:15:54 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-5132e233-9800-4e21-a0eb-d4792c9157d9 req-7eef2ab1-bbec-414b-949d-5d5ce1aaf93a tempest-ServerActionsTestOtherA-1179246485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:15:55 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.info" returned: 0 in 0.328s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.748s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-5132e233-9800-4e21-a0eb-d4792c9157d9 req-7eef2ab1-bbec-414b-949d-5d5ce1aaf93a tempest-ServerActionsTestOtherA-1179246485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.290s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:15:55 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[642519a5-ee87-4c62-90c8-14c408c4ea02]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:15:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5132e233-9800-4e21-a0eb-d4792c9157d9 req-7eef2ab1-bbec-414b-949d-5d5ce1aaf93a tempest-ServerActionsTestOtherA-1179246485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:55 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-4cd3108f-9ebc-40a9-a70d-02dce3040f5c tempest-GroupSnapshotsV319Test-1981215360 None] group_snapshot 848adbe7-19c1-4cae-928c-d26b609f02f2: created successfully Jul 14 21:15:55 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137 Jul 14 21:15:55 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:55 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5132e233-9800-4e21-a0eb-d4792c9157d9 req-7eef2ab1-bbec-414b-949d-5d5ce1aaf93a tempest-ServerActionsTestOtherA-1179246485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137" returned: 0 in 0.465s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-5132e233-9800-4e21-a0eb-d4792c9157d9 req-7eef2ab1-bbec-414b-949d-5d5ce1aaf93a tempest-ServerActionsTestOtherA-1179246485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.500s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:15:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-5132e233-9800-4e21-a0eb-d4792c9157d9 req-7eef2ab1-bbec-414b-949d-5d5ce1aaf93a tempest-ServerActionsTestOtherA-1179246485 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-172988b0-c1ee-40d0-b500-854adaa18137', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8abe1041-df65-427f-bb74-134ae0fb6301', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:15:55 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-5132e233-9800-4e21-a0eb-d4792c9157d9 req-7eef2ab1-bbec-414b-949d-5d5ce1aaf93a tempest-ServerActionsTestOtherA-1179246485 None] attachment_update completed successfully. Jul 14 21:15:56 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] group_snapshot 848adbe7-19c1-4cae-928c-d26b609f02f2: deleting Jul 14 21:15:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] group_snapshot 848adbe7-19c1-4cae-928c-d26b609f02f2: deleting {{(pid=88300) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 14 21:15:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] Acquiring lock "cinder-quobyte-74ecd03b-e1e9-4927-b86e-76559a0244ce" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:15:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] Lock "cinder-quobyte-74ecd03b-e1e9-4927-b86e-76559a0244ce" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:15:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] Acquiring lock "cinder-quobyte-316740a3-4879-4344-8416-5cb054bcba55" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:15:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] Lock "cinder-quobyte-316740a3-4879-4344-8416-5cb054bcba55" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:15:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] Deleting offline snapshot 316740a3-4879-4344-8416-5cb054bcba55 of volume 74ecd03b-e1e9-4927-b86e-76559a0244ce {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:15:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] snapshot_file for this snap is: volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:15:56 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3342b4be-93f2-40a6-aa4c-1014407caa39]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:15:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:56 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55 Jul 14 21:15:56 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:57 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55" returned: 0 in 0.425s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74ecd03b-e1e9-4927-b86e-76559a0244ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:15:57 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d852f24-699b-4190-a83d-1c4af18e0914]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:15:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:57 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce Jul 14 21:15:57 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:57 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce" returned: 0 in 0.406s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:57 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55 Jul 14 21:15:57 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:58 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55" returned: 0 in 0.470s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:15:58 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55 Jul 14 21:15:58 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:15:58 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Jul 14 21:15:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce.316740a3-4879-4344-8416-5cb054bcba55" returned: 0 in 0.285s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:15:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] Lock "cinder-quobyte-316740a3-4879-4344-8416-5cb054bcba55" released by "_delete_snapshot" :: held 1.704s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:15:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] Lock "cinder-quobyte-74ecd03b-e1e9-4927-b86e-76559a0244ce" released by "delete_snapshot" :: held 1.738s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:15:58 devstack cinder-volume[88300]: WARNING cinder.quota [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-878189640 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-878189640, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:15:58 devstack cinder-volume[88300]: WARNING cinder.quota [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-878189640 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-878189640, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:15:58 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] Created reservations ['92664f6c-a584-433b-a141-4c34da91d8f4', 'bdbc6d6c-941f-440d-bd16-e1f000915689', 'ddeab5d5-1c57-4083-ab47-5d654491b0a0', 'df6290cb-441d-4f06-b478-9bc9b1e5df44'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:15:58 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-ded4e477-a32e-4d65-b4c2-f6d74c187a3d tempest-GroupSnapshotsV319Test-1981215360 None] group_snapshot 848adbe7-19c1-4cae-928c-d26b609f02f2: deleted successfully Jul 14 21:15:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] Acquiring lock "cinder-quobyte-74ecd03b-e1e9-4927-b86e-76559a0244ce" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:15:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] Lock "cinder-quobyte-74ecd03b-e1e9-4927-b86e-76559a0244ce" acquired by "delete_volume" :: waited 0.033s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:15:59 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[551f0f8e-6274-4a76-8ace-2eec08c7365a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:15:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:00 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce Jul 14 21:16:00 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:00 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce" returned: 0 in 0.571s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:00 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce Jul 14 21:16:00 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:00 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-74ecd03b-e1e9-4927-b86e-76559a0244ce" returned: 0 in 0.344s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] Lock "cinder-quobyte-74ecd03b-e1e9-4927-b86e-76559a0244ce" released by "delete_volume" :: held 1.016s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:16:00 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] Created reservations ['d212bff1-44c6-4297-acd3-7225fecf6bbf'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:16:01 devstack cinder-volume[88300]: WARNING cinder.quota [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-878189640 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-878189640, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:16:01 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] Created reservations ['3cb0a073-d6bf-463d-9a12-3173177a10f8', '0c71894f-c8d9-48a2-bb96-65dc7a630c5d', '37e2582e-538b-4432-9cf0-cba74c24652c', '77571a0c-9bf6-4675-9f6d-870e6af390e8'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:16:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:16:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:16:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:01 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:16:01 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:01 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-13b34727-ddc4-4377-813e-998e8a306ea1 req-72e5c650-bfd8-4f7e-a108-fc18ce303433 tempest-ServerActionsTestOtherA-1179246485 None] Terminate volume connection completed successfully. Jul 14 21:16:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-13b34727-ddc4-4377-813e-998e8a306ea1 req-72e5c650-bfd8-4f7e-a108-fc18ce303433 tempest-ServerActionsTestOtherA-1179246485 None] Deleting attachment 8abe1041-df65-427f-bb74-134ae0fb6301. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:16:01 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.343s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:01 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:16:01 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-4964ead5-ac61-4164-b481-f7098d687440 tempest-GroupSnapshotsV319Test-1981215360 None] Delete group completed successfully. Jul 14 21:16:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-13b34727-ddc4-4377-813e-998e8a306ea1 req-3a4e6781-8272-4efe-a537-719befc525fd tempest-ServerActionsTestOtherA-1179246485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-13b34727-ddc4-4377-813e-998e8a306ea1 req-3a4e6781-8272-4efe-a537-719befc525fd tempest-ServerActionsTestOtherA-1179246485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:02 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9554e70d-2648-4653-bf86-67e9bb6d7b1e]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:16:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-13b34727-ddc4-4377-813e-998e8a306ea1 req-3a4e6781-8272-4efe-a537-719befc525fd tempest-ServerActionsTestOtherA-1179246485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:02 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137 Jul 14 21:16:02 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:03 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-13b34727-ddc4-4377-813e-998e8a306ea1 req-3a4e6781-8272-4efe-a537-719befc525fd tempest-ServerActionsTestOtherA-1179246485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137" returned: 0 in 0.635s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-13b34727-ddc4-4377-813e-998e8a306ea1 req-3a4e6781-8272-4efe-a537-719befc525fd tempest-ServerActionsTestOtherA-1179246485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.664s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-13b34727-ddc4-4377-813e-998e8a306ea1 req-3a4e6781-8272-4efe-a537-719befc525fd tempest-ServerActionsTestOtherA-1179246485 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-172988b0-c1ee-40d0-b500-854adaa18137', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80f94e15-900f-4476-93cf-4f14799ea683', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:16:03 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-13b34727-ddc4-4377-813e-998e8a306ea1 req-3a4e6781-8272-4efe-a537-719befc525fd tempest-ServerActionsTestOtherA-1179246485 None] attachment_update completed successfully. Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Flow 'volume_create_manager' (c5754b76-a875-421d-b8cd-b749b074589f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1edf8f24-6a3f-40f5-bc46-ca3073fc7c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1edf8f24-6a3f-40f5-bc46-ca3073fc7c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1500976969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879cd95b-0141-4db8-a6b7-034e7e870900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a301165f824f64992ead71e4b05cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:16:11Z,use_quota=True,user_id='8e9b9d958c34498eac028cac387c1f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b9d2e6a-f8b0-4f53-afbc-ace49f1a0a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b9d2e6a-f8b0-4f53-afbc-ace49f1a0a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fcefcd-00ac-49c9-93af-19e63c55af0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fcefcd-00ac-49c9-93af-19e63c55af0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '879cd95b-0141-4db8-a6b7-034e7e870900', 'volume_name': 'volume-879cd95b-0141-4db8-a6b7-034e7e870900', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06482ddb-74ca-4924-b487-9fa38f49f8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06482ddb-74ca-4924-b487-9fa38f49f8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57571615-2273-4774-9225-7d6c6c2c2872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:11 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Volume 879cd95b-0141-4db8-a6b7-034e7e870900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-879cd95b-0141-4db8-a6b7-034e7e870900', 'volume_size': 1} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1500976969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879cd95b-0141-4db8-a6b7-034e7e870900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a301165f824f64992ead71e4b05cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:16:11Z,use_quota=True,user_id='8e9b9d958c34498eac028cac387c1f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Creating volume 879cd95b-0141-4db8-a6b7-034e7e870900 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:16:11 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:16:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-879cd95b-0141-4db8-a6b7-034e7e870900 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:11 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-879cd95b-0141-4db8-a6b7-034e7e870900 1073741824 Jul 14 21:16:11 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:12 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-879cd95b-0141-4db8-a6b7-034e7e870900 1073741824" returned: 0 in 0.830s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-879cd95b-0141-4db8-a6b7-034e7e870900 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:12 devstack sudo[91452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-879cd95b-0141-4db8-a6b7-034e7e870900 Jul 14 21:16:12 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:12 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-879cd95b-0141-4db8-a6b7-034e7e870900" returned: 0 in 0.317s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:16:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57571615-2273-4774-9225-7d6c6c2c2872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-879cd95b-0141-4db8-a6b7-034e7e870900', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce93de4-84ba-4ae1-81b8-7b79f5f4e739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:12 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Volume volume-879cd95b-0141-4db8-a6b7-034e7e870900 (879cd95b-0141-4db8-a6b7-034e7e870900): created successfully Jul 14 21:16:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce93de4-84ba-4ae1-81b8-7b79f5f4e739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Flow 'volume_create_manager' (c5754b76-a875-421d-b8cd-b749b074589f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:16:12 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-3b40fa3b-ef8c-4e6e-99ef-6cc08457bd78 tempest-TaggedAttachmentsTest-1374571365 None] Created volume successfully. Jul 14 21:16:15 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e3443efd-7781-4e6b-9036-2959878f4984 tempest-GroupsTest-627270274 None] Group tempest-Group1-219888035: creating Jul 14 21:16:16 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e3443efd-7781-4e6b-9036-2959878f4984 tempest-GroupsTest-627270274 None] Group tempest-Group1-219888035: created successfully Jul 14 21:16:16 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e3443efd-7781-4e6b-9036-2959878f4984 tempest-GroupsTest-627270274 None] Create group completed successfully. Jul 14 21:16:17 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2e2adfd6-1028-4d3e-a1e6-d828700d5877 tempest-GroupsTest-627270274 None] Group tempest-Group2-902633074: creating Jul 14 21:16:17 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2e2adfd6-1028-4d3e-a1e6-d828700d5877 tempest-GroupsTest-627270274 None] Group tempest-Group2-902633074: created successfully Jul 14 21:16:17 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2e2adfd6-1028-4d3e-a1e6-d828700d5877 tempest-GroupsTest-627270274 None] Create group completed successfully. Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Flow 'volume_create_manager' (a6a2ae4c-d9d0-4d19-823e-12d90d40764e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87b0bb2-fc4e-4f4d-9ec4-3e80aa4640a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87b0bb2-fc4e-4f4d-9ec4-3e80aa4640a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1827791845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=366c50df-a40e-4c3d-bb24-fff6e1d1a92d,host='devstack@QuobyteHD#QuobyteHD',id=08977e65-5dc6-468c-abea-b8a2fc1ec3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee9cd96da0004902b39a0546bd33f1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:16:19Z,use_quota=True,user_id='483e0ff8062b4f908628916a90820da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c788ac-2a27-4108-8ed9-56095932ffca),volume_type_id=62c788ac-2a27-4108-8ed9-56095932ffca)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c92a886-48f3-4bc5-a52b-bd3e332fd6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c92a886-48f3-4bc5-a52b-bd3e332fd6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a185fe-004d-468f-b436-295b84f7dab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a185fe-004d-468f-b436-295b84f7dab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08977e65-5dc6-468c-abea-b8a2fc1ec3c9', 'volume_name': 'volume-08977e65-5dc6-468c-abea-b8a2fc1ec3c9', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa36510-7157-4389-b42b-a64d3c5bdaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa36510-7157-4389-b42b-a64d3c5bdaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882e69d1-04d7-44b9-bdf6-7325152777cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:19 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Volume 08977e65-5dc6-468c-abea-b8a2fc1ec3c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08977e65-5dc6-468c-abea-b8a2fc1ec3c9', 'volume_size': 1} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=366c50df-a40e-4c3d-bb24-fff6e1d1a92d,created_at=2026-07-14T19:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1827791845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=366c50df-a40e-4c3d-bb24-fff6e1d1a92d,host='devstack@QuobyteHD#QuobyteHD',id=08977e65-5dc6-468c-abea-b8a2fc1ec3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee9cd96da0004902b39a0546bd33f1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:16:19Z,use_quota=True,user_id='483e0ff8062b4f908628916a90820da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62c788ac-2a27-4108-8ed9-56095932ffca),volume_type_id=62c788ac-2a27-4108-8ed9-56095932ffca)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Creating volume 08977e65-5dc6-468c-abea-b8a2fc1ec3c9 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:16:19 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:16:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-08977e65-5dc6-468c-abea-b8a2fc1ec3c9 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:19 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-08977e65-5dc6-468c-abea-b8a2fc1ec3c9 1073741824 Jul 14 21:16:19 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:20 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-08977e65-5dc6-468c-abea-b8a2fc1ec3c9 1073741824" returned: 0 in 0.706s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-08977e65-5dc6-468c-abea-b8a2fc1ec3c9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:20 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-08977e65-5dc6-468c-abea-b8a2fc1ec3c9 Jul 14 21:16:20 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:20 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-08977e65-5dc6-468c-abea-b8a2fc1ec3c9" returned: 0 in 0.345s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:16:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882e69d1-04d7-44b9-bdf6-7325152777cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08977e65-5dc6-468c-abea-b8a2fc1ec3c9', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb12967b-cb3c-4ee0-ba1c-a61df45e5db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:20 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Volume volume-08977e65-5dc6-468c-abea-b8a2fc1ec3c9 (08977e65-5dc6-468c-abea-b8a2fc1ec3c9): created successfully Jul 14 21:16:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb12967b-cb3c-4ee0-ba1c-a61df45e5db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Flow 'volume_create_manager' (a6a2ae4c-d9d0-4d19-823e-12d90d40764e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:16:20 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-64b06ad8-9191-42dd-ba3f-d992b07213c6 tempest-GroupsTest-627270274 None] Created volume successfully. Jul 14 21:16:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] Acquiring lock "cinder-quobyte-08977e65-5dc6-468c-abea-b8a2fc1ec3c9" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:16:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] Lock "cinder-quobyte-08977e65-5dc6-468c-abea-b8a2fc1ec3c9" acquired by "delete_volume" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:16:22 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9f1a70-538b-4969-b416-29ca47063197]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:16:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-08977e65-5dc6-468c-abea-b8a2fc1ec3c9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:22 devstack sudo[91549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-08977e65-5dc6-468c-abea-b8a2fc1ec3c9 Jul 14 21:16:22 devstack sudo[91549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:23 devstack sudo[91549]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-08977e65-5dc6-468c-abea-b8a2fc1ec3c9" returned: 0 in 0.530s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-08977e65-5dc6-468c-abea-b8a2fc1ec3c9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:23 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-08977e65-5dc6-468c-abea-b8a2fc1ec3c9 Jul 14 21:16:23 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:23 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-08977e65-5dc6-468c-abea-b8a2fc1ec3c9" returned: 0 in 0.298s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:23 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] Lock "cinder-quobyte-08977e65-5dc6-468c-abea-b8a2fc1ec3c9" released by "delete_volume" :: held 0.875s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:16:23 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] Created reservations ['42689c55-d595-43a9-b173-9895ed5e83d6'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:16:23 devstack cinder-volume[88300]: WARNING cinder.quota [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1254969150 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1254969150, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:16:23 devstack cinder-volume[88300]: WARNING cinder.quota [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1254969150 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1254969150, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:16:23 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] Created reservations ['bb2656b7-7d13-4209-b9ce-4c1a80679348', '4a01c185-4fd9-4165-8a29-f2f62af6366d', 'e530ca61-9f38-4cea-bfbe-85de3c327c4b', '211a5389-8d53-44ff-8f05-c74666b2f7a4'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:16:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:16:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:16:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:23 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:16:23 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:24 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.436s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:24 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:16:24 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-fdfa72a1-7f24-4c04-a9d0-d19427105bf0 tempest-GroupsTest-627270274 None] Delete group completed successfully. Jul 14 21:16:25 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-f2304a13-ae91-4f45-98a6-e15503126afb tempest-GroupsTest-627270274 None] Created reservations ['00d2f9d9-ffe9-4750-be62-64fda0952d6f'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:16:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f2304a13-ae91-4f45-98a6-e15503126afb tempest-GroupsTest-627270274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f2304a13-ae91-4f45-98a6-e15503126afb tempest-GroupsTest-627270274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f2304a13-ae91-4f45-98a6-e15503126afb tempest-GroupsTest-627270274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:16:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f2304a13-ae91-4f45-98a6-e15503126afb tempest-GroupsTest-627270274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:16:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f2304a13-ae91-4f45-98a6-e15503126afb tempest-GroupsTest-627270274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f2304a13-ae91-4f45-98a6-e15503126afb tempest-GroupsTest-627270274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:25 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:16:25 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:25 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f2304a13-ae91-4f45-98a6-e15503126afb tempest-GroupsTest-627270274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.321s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:25 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-f2304a13-ae91-4f45-98a6-e15503126afb tempest-GroupsTest-627270274 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:16:25 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f2304a13-ae91-4f45-98a6-e15503126afb tempest-GroupsTest-627270274 None] Delete group completed successfully. Jul 14 21:16:26 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-6ec73465-7ad8-4110-9d50-331497274663 tempest-GroupsTest-627270274 None] Group tempest-GroupsTest-Group-2055393998: creating Jul 14 21:16:26 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-6ec73465-7ad8-4110-9d50-331497274663 tempest-GroupsTest-627270274 None] Group tempest-GroupsTest-Group-2055393998: created successfully Jul 14 21:16:26 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-6ec73465-7ad8-4110-9d50-331497274663 tempest-GroupsTest-627270274 None] Create group completed successfully. Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=85,cinder:UPDATE=71,cinder:DELETE=4,cinder:INSERT=13 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Flow 'volume_create_manager' (dcc1fe0d-f721-4efc-b633-e99e07ce766a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a71875-d128-48a7-bd55-f484716d765b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a71875-d128-48a7-bd55-f484716d765b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1352014661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ce61d75-f65e-4f46-a2ee-9bd3d767405f,host='devstack@QuobyteHD#QuobyteHD',id=291fc87c-0de2-4b34-ad89-1e897358a4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee9cd96da0004902b39a0546bd33f1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:16:29Z,use_quota=True,user_id='483e0ff8062b4f908628916a90820da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(333bb9d3-7880-46c7-aa4c-bf4c872e609f),volume_type_id=333bb9d3-7880-46c7-aa4c-bf4c872e609f)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ada9215-6f86-4ae2-b87a-d4772c215777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ada9215-6f86-4ae2-b87a-d4772c215777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b0e81f-271e-4622-a032-79a6e78e7f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b0e81f-271e-4622-a032-79a6e78e7f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '291fc87c-0de2-4b34-ad89-1e897358a4f0', 'volume_name': 'volume-291fc87c-0de2-4b34-ad89-1e897358a4f0', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df982266-ad17-43f2-84d7-1d85a3db118d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df982266-ad17-43f2-84d7-1d85a3db118d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569cf648-150f-4a62-8653-bf9636617e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:29 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Volume 291fc87c-0de2-4b34-ad89-1e897358a4f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-291fc87c-0de2-4b34-ad89-1e897358a4f0', 'volume_size': 1} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0ce61d75-f65e-4f46-a2ee-9bd3d767405f,created_at=2026-07-14T19:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1352014661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ce61d75-f65e-4f46-a2ee-9bd3d767405f,host='devstack@QuobyteHD#QuobyteHD',id=291fc87c-0de2-4b34-ad89-1e897358a4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee9cd96da0004902b39a0546bd33f1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:16:29Z,use_quota=True,user_id='483e0ff8062b4f908628916a90820da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(333bb9d3-7880-46c7-aa4c-bf4c872e609f),volume_type_id=333bb9d3-7880-46c7-aa4c-bf4c872e609f)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Creating volume 291fc87c-0de2-4b34-ad89-1e897358a4f0 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:16:29 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:16:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-291fc87c-0de2-4b34-ad89-1e897358a4f0 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:29 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-291fc87c-0de2-4b34-ad89-1e897358a4f0 1073741824 Jul 14 21:16:29 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:30 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-291fc87c-0de2-4b34-ad89-1e897358a4f0 1073741824" returned: 0 in 1.079s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-291fc87c-0de2-4b34-ad89-1e897358a4f0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:30 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-291fc87c-0de2-4b34-ad89-1e897358a4f0 Jul 14 21:16:30 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:31 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-291fc87c-0de2-4b34-ad89-1e897358a4f0" returned: 0 in 0.499s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:16:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569cf648-150f-4a62-8653-bf9636617e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-291fc87c-0de2-4b34-ad89-1e897358a4f0', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4d3920-99a0-4993-b071-954c432bfcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:31 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Volume volume-291fc87c-0de2-4b34-ad89-1e897358a4f0 (291fc87c-0de2-4b34-ad89-1e897358a4f0): created successfully Jul 14 21:16:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4d3920-99a0-4993-b071-954c432bfcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Flow 'volume_create_manager' (dcc1fe0d-f721-4efc-b633-e99e07ce766a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:16:31 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2b5893b8-5552-48da-adb3-1b60952dc448 tempest-GroupsTest-627270274 None] Created volume successfully. Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Flow 'volume_create_manager' (3973db1e-b829-465c-9465-4a401d7b63a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9003404c-2323-4386-bbf1-9a7ce3ea614b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9003404c-2323-4386-bbf1-9a7ce3ea614b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1382943244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ce61d75-f65e-4f46-a2ee-9bd3d767405f,host='devstack@QuobyteHD#QuobyteHD',id=9b5f9376-a3f8-489f-a70c-18a4f892d616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee9cd96da0004902b39a0546bd33f1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:16:33Z,use_quota=True,user_id='483e0ff8062b4f908628916a90820da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(333bb9d3-7880-46c7-aa4c-bf4c872e609f),volume_type_id=333bb9d3-7880-46c7-aa4c-bf4c872e609f)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4322fd8d-9de1-4f83-9577-27de8ba5890b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4322fd8d-9de1-4f83-9577-27de8ba5890b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09dee09-d023-49c1-8a4c-c7d678635d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09dee09-d023-49c1-8a4c-c7d678635d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b5f9376-a3f8-489f-a70c-18a4f892d616', 'volume_name': 'volume-9b5f9376-a3f8-489f-a70c-18a4f892d616', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e069bf05-0be5-448b-a3f9-6fe68fb3755b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e069bf05-0be5-448b-a3f9-6fe68fb3755b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b195a428-fc38-4c51-9435-265bc5e20384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:33 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Volume 9b5f9376-a3f8-489f-a70c-18a4f892d616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b5f9376-a3f8-489f-a70c-18a4f892d616', 'volume_size': 1} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0ce61d75-f65e-4f46-a2ee-9bd3d767405f,created_at=2026-07-14T19:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1382943244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ce61d75-f65e-4f46-a2ee-9bd3d767405f,host='devstack@QuobyteHD#QuobyteHD',id=9b5f9376-a3f8-489f-a70c-18a4f892d616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee9cd96da0004902b39a0546bd33f1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:16:33Z,use_quota=True,user_id='483e0ff8062b4f908628916a90820da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(333bb9d3-7880-46c7-aa4c-bf4c872e609f),volume_type_id=333bb9d3-7880-46c7-aa4c-bf4c872e609f)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Creating volume 9b5f9376-a3f8-489f-a70c-18a4f892d616 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:16:33 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:16:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9b5f9376-a3f8-489f-a70c-18a4f892d616 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:33 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9b5f9376-a3f8-489f-a70c-18a4f892d616 1073741824 Jul 14 21:16:33 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:34 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9b5f9376-a3f8-489f-a70c-18a4f892d616 1073741824" returned: 0 in 0.804s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9b5f9376-a3f8-489f-a70c-18a4f892d616 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:34 devstack sudo[91811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9b5f9376-a3f8-489f-a70c-18a4f892d616 Jul 14 21:16:34 devstack sudo[91811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:34 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-6c5f894d-1926-4d3c-897e-be38136cf984 req-84fcd902-a00c-4a3b-973c-81d09480c811 tempest-ServerActionsTestOtherA-1179246485 None] Terminate volume connection completed successfully. Jul 14 21:16:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-6c5f894d-1926-4d3c-897e-be38136cf984 req-84fcd902-a00c-4a3b-973c-81d09480c811 tempest-ServerActionsTestOtherA-1179246485 None] Deleting attachment 80f94e15-900f-4476-93cf-4f14799ea683. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:16:35 devstack sudo[91811]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9b5f9376-a3f8-489f-a70c-18a4f892d616" returned: 0 in 0.542s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:16:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b195a428-fc38-4c51-9435-265bc5e20384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b5f9376-a3f8-489f-a70c-18a4f892d616', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b259c2b-fe3b-492a-a5ec-1052f5572e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:35 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Volume volume-9b5f9376-a3f8-489f-a70c-18a4f892d616 (9b5f9376-a3f8-489f-a70c-18a4f892d616): created successfully Jul 14 21:16:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b259c2b-fe3b-492a-a5ec-1052f5572e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Flow 'volume_create_manager' (3973db1e-b829-465c-9465-4a401d7b63a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:16:35 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-92ae1652-71da-44d3-9f99-e8af8eea5c15 tempest-GroupsTest-627270274 None] Created volume successfully. Jul 14 21:16:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:16:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:16:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:16:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:36 devstack sudo[91837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:16:36 devstack sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:36 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-1522ed65-b13a-4b85-a6df-cc4afb65d226 tempest-GroupsTest-627270274 None] Update group completed successfully. Jul 14 21:16:37 devstack sudo[91837]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.637s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:37 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:16:37 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:16:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 8 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:16:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:16:38 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:UPDATE=82,cinder:SELECT=82,cinder:INSERT=17,cinder:DELETE=5 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:16:38 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-61af30e1-bd60-427e-91a0-707baad76d92 tempest-GroupsTest-627270274 None] Update group completed successfully. Jul 14 21:16:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Acquiring lock "cinder-quobyte-291fc87c-0de2-4b34-ad89-1e897358a4f0" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:16:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Lock "cinder-quobyte-291fc87c-0de2-4b34-ad89-1e897358a4f0" acquired by "delete_volume" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:16:40 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[208e9e13-87ad-43b5-b521-f2b96355f316]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:16:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-291fc87c-0de2-4b34-ad89-1e897358a4f0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:40 devstack sudo[91872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-291fc87c-0de2-4b34-ad89-1e897358a4f0 Jul 14 21:16:40 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:40 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-291fc87c-0de2-4b34-ad89-1e897358a4f0" returned: 0 in 0.468s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-291fc87c-0de2-4b34-ad89-1e897358a4f0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:40 devstack sudo[91877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-291fc87c-0de2-4b34-ad89-1e897358a4f0 Jul 14 21:16:40 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:41 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-291fc87c-0de2-4b34-ad89-1e897358a4f0" returned: 0 in 0.349s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Lock "cinder-quobyte-291fc87c-0de2-4b34-ad89-1e897358a4f0" released by "delete_volume" :: held 0.877s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:16:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Acquiring lock "cinder-quobyte-9b5f9376-a3f8-489f-a70c-18a4f892d616" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:16:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Lock "cinder-quobyte-9b5f9376-a3f8-489f-a70c-18a4f892d616" acquired by "delete_volume" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:16:41 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0aecef4-25d3-429a-a419-abd530cbfb5b]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:16:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9b5f9376-a3f8-489f-a70c-18a4f892d616 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:41 devstack sudo[91880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9b5f9376-a3f8-489f-a70c-18a4f892d616 Jul 14 21:16:41 devstack sudo[91880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:41 devstack sudo[91880]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9b5f9376-a3f8-489f-a70c-18a4f892d616" returned: 0 in 0.443s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9b5f9376-a3f8-489f-a70c-18a4f892d616 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:41 devstack sudo[91887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9b5f9376-a3f8-489f-a70c-18a4f892d616 Jul 14 21:16:41 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:41 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] Acquiring lock "cinder-172988b0-c1ee-40d0-b500-854adaa18137-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:16:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9b5f9376-a3f8-489f-a70c-18a4f892d616" returned: 0 in 0.301s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Lock "cinder-quobyte-9b5f9376-a3f8-489f-a70c-18a4f892d616" released by "delete_volume" :: held 0.789s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:16:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] Lock "cinder-172988b0-c1ee-40d0-b500-854adaa18137-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] Acquiring lock "cinder-quobyte-172988b0-c1ee-40d0-b500-854adaa18137" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] Lock "cinder-quobyte-172988b0-c1ee-40d0-b500-854adaa18137" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e259d88a-cd19-4b98-acaa-d4f74d53d673]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Created reservations ['9da0db16-c777-42c4-8351-d33f7fabe1aa'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:16:42 devstack cinder-volume[88300]: WARNING cinder.quota [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1460786918 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1460786918, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:16:42 devstack cinder-volume[88300]: WARNING cinder.quota [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1460786918 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1460786918, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Created reservations ['ccc5af1e-ccd8-42be-ae0b-d9a2c5e5cb91', '12f84dd9-6096-422f-82fb-25ac02f025d6', '8adac275-3a0c-46ae-b9c3-712d0b31a6aa', '33c2cce1-87fa-4945-96eb-4988b10ba667'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:16:42 devstack sudo[91890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137 Jul 14 21:16:42 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Created reservations ['ca05d4e5-7b67-4ddc-94bc-c3ce067b93d3', 'f5ce213c-7c2b-47cc-823d-f0269c5f4e18', 'deac758a-31e7-4119-97fd-325990e19752', '1d126089-bd7f-4bd9-b2de-666504369acd'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:42 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:16:42 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:42 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137" returned: 0 in 0.379s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:42 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137 Jul 14 21:16:42 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:42 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.302s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:16:42 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-418155ec-00b1-4d69-bf21-9ab15e969e3a tempest-GroupsTest-627270274 None] Delete group completed successfully. Jul 14 21:16:42 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-172988b0-c1ee-40d0-b500-854adaa18137" returned: 0 in 0.248s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] Lock "cinder-quobyte-172988b0-c1ee-40d0-b500-854adaa18137" released by "delete_volume" :: held 0.675s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] Created reservations ['eeb6058a-f2df-4512-80a8-550e8ae79d2f', '55b0ec96-7629-41f3-88c9-02d84ea56631', '94279bdf-6658-4d41-9bad-488ae5359930', '8ba294d0-2920-4e96-96b2-65f0f04d85e6'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:42 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:16:42 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:43 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.290s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:43 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:16:43 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] Deleted volume successfully. Jul 14 21:16:43 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9411021c-73b2-440a-beac-2da1e31eddac tempest-ServerActionsTestOtherA-1179246485 None] Lock "cinder-172988b0-c1ee-40d0-b500-854adaa18137-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:16:52 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=30,cinder:INSERT=8,cinder:UPDATE=33 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:16:53 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=16,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:16:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-f9784dd1-6423-4406-97e0-1a4e501783d1 req-937943b6-0e4a-4a74-a687-52084a2a0bf9 tempest-TaggedAttachmentsTest-1374571365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-f9784dd1-6423-4406-97e0-1a4e501783d1 req-937943b6-0e4a-4a74-a687-52084a2a0bf9 tempest-TaggedAttachmentsTest-1374571365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:56 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecc0b09-73e4-4d57-b979-7bf6eb083b6d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:16:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-f9784dd1-6423-4406-97e0-1a4e501783d1 req-937943b6-0e4a-4a74-a687-52084a2a0bf9 tempest-TaggedAttachmentsTest-1374571365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-879cd95b-0141-4db8-a6b7-034e7e870900 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:56 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-879cd95b-0141-4db8-a6b7-034e7e870900 Jul 14 21:16:56 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:57 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-f9784dd1-6423-4406-97e0-1a4e501783d1 req-937943b6-0e4a-4a74-a687-52084a2a0bf9 tempest-TaggedAttachmentsTest-1374571365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-879cd95b-0141-4db8-a6b7-034e7e870900" returned: 0 in 0.390s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-f9784dd1-6423-4406-97e0-1a4e501783d1 req-937943b6-0e4a-4a74-a687-52084a2a0bf9 tempest-TaggedAttachmentsTest-1374571365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.407s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-f9784dd1-6423-4406-97e0-1a4e501783d1 req-937943b6-0e4a-4a74-a687-52084a2a0bf9 tempest-TaggedAttachmentsTest-1374571365 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-879cd95b-0141-4db8-a6b7-034e7e870900', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bdb25a5e-172b-4ea8-8b45-37b2e9ca5213', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:16:57 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-f9784dd1-6423-4406-97e0-1a4e501783d1 req-937943b6-0e4a-4a74-a687-52084a2a0bf9 tempest-TaggedAttachmentsTest-1374571365 None] attachment_update completed successfully. Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Flow 'volume_create_manager' (12ad96d7-cc7b-4ced-aee9-7a37a5b3753e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239babcf-3ddb-4a31-8453-b3ec78774533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239babcf-3ddb-4a31-8453-b3ec78774533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-977891608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25212808-e1db-4467-b6a4-66643be129ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5f1006065740ffb764a617babd134d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:16:58Z,use_quota=True,user_id='f9cbc01f1790498aaab0aa6e841b51bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ff022a-c13a-4a78-aea0-034426dc6a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ff022a-c13a-4a78-aea0-034426dc6a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9c5c90-a582-4a40-9bc7-fdeb43d196cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9c5c90-a582-4a40-9bc7-fdeb43d196cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25212808-e1db-4467-b6a4-66643be129ca', 'volume_name': 'volume-25212808-e1db-4467-b6a4-66643be129ca', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af1ae0c5-5607-45e3-92e3-153bb1036693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af1ae0c5-5607-45e3-92e3-153bb1036693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f8b066-b659-4653-94bd-5415a1044d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:58 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Volume 25212808-e1db-4467-b6a4-66643be129ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25212808-e1db-4467-b6a4-66643be129ca', 'volume_size': 1} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-977891608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25212808-e1db-4467-b6a4-66643be129ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5f1006065740ffb764a617babd134d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:16:58Z,use_quota=True,user_id='f9cbc01f1790498aaab0aa6e841b51bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Creating volume 25212808-e1db-4467-b6a4-66643be129ca {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:16:58 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-25212808-e1db-4467-b6a4-66643be129ca 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:58 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-25212808-e1db-4467-b6a4-66643be129ca 1073741824 Jul 14 21:16:58 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Flow 'volume_create_manager' (1c2c50af-6f7f-43ac-83d5-8d32c1e9229c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c35497-e665-467a-9f02-8968a2def9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c35497-e665-467a-9f02-8968a2def9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1002796791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7472be6d648d490dba2726a631060c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:16:59Z,use_quota=True,user_id='5c95963ce2ee41749f8f1ce2a486c314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242ee232-ac56-4e57-aac6-ccfc2eff4902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242ee232-ac56-4e57-aac6-ccfc2eff4902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f328ec-8bb1-4eee-888a-884877cab431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f328ec-8bb1-4eee-888a-884877cab431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa', 'volume_name': 'volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c271aa-05ae-4a0a-a976-b92005fcefa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c271aa-05ae-4a0a-a976-b92005fcefa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ff30ff-6e64-46bd-85b9-3a6d9d5e994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:58 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Volume b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa', 'volume_size': 1} Jul 14 21:16:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:59 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-25212808-e1db-4467-b6a4-66643be129ca 1073741824" returned: 0 in 0.646s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-25212808-e1db-4467-b6a4-66643be129ca {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:59 devstack sudo[92425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-25212808-e1db-4467-b6a4-66643be129ca Jul 14 21:16:59 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:59 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-25212808-e1db-4467-b6a4-66643be129ca" returned: 0 in 0.298s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.663s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1002796791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7472be6d648d490dba2726a631060c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:16:59Z,use_quota=True,user_id='5c95963ce2ee41749f8f1ce2a486c314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Creating volume b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:16:59 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f8b066-b659-4653-94bd-5415a1044d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25212808-e1db-4467-b6a4-66643be129ca', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:59 devstack sudo[92429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa 1073741824 Jul 14 21:16:59 devstack sudo[92429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acda0b66-47d6-46dd-accb-3b1b643faa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:16:59 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Volume volume-25212808-e1db-4467-b6a4-66643be129ca (25212808-e1db-4467-b6a4-66643be129ca): created successfully Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acda0b66-47d6-46dd-accb-3b1b643faa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Flow 'volume_create_manager' (12ad96d7-cc7b-4ced-aee9-7a37a5b3753e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:16:59 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-97f0d58c-4135-4801-94a9-bf006cba7a3a tempest-VolumeQuotasAdminTestJSON-1798867117 None] Created volume successfully. Jul 14 21:16:59 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-30fc5749-3f82-483b-9c97-9ca4ac192eb4 req-e3413746-9af9-4542-82ee-3c138954fa5c tempest-TaggedAttachmentsTest-1374571365 None] Terminate volume connection completed successfully. Jul 14 21:16:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-30fc5749-3f82-483b-9c97-9ca4ac192eb4 req-e3413746-9af9-4542-82ee-3c138954fa5c tempest-TaggedAttachmentsTest-1374571365 None] Deleting attachment bdb25a5e-172b-4ea8-8b45-37b2e9ca5213. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:17:00 devstack sudo[92429]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa 1073741824" returned: 0 in 0.566s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:00 devstack sudo[92460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa Jul 14 21:17:00 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:00 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa" returned: 0 in 0.299s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:17:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ff30ff-6e64-46bd-85b9-3a6d9d5e994a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7daf19f-24d7-484c-b64f-687548258e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:00 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Volume volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa (b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa): created successfully Jul 14 21:17:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7daf19f-24d7-484c-b64f-687548258e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Flow 'volume_create_manager' (1c2c50af-6f7f-43ac-83d5-8d32c1e9229c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:17:00 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-12138779-dd67-4724-8705-f87bc89d36f5 tempest-AttachVolumeTestJSON-1079889311 None] Created volume successfully. Jul 14 21:17:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Acquiring lock "cinder-25212808-e1db-4467-b6a4-66643be129ca-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:17:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Lock "cinder-25212808-e1db-4467-b6a4-66643be129ca-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:17:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Acquiring lock "cinder-quobyte-25212808-e1db-4467-b6a4-66643be129ca" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:17:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Lock "cinder-quobyte-25212808-e1db-4467-b6a4-66643be129ca" acquired by "delete_volume" :: waited 0.045s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:17:00 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2deebe2-4cb3-447a-985f-37a7237fe330]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:17:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-25212808-e1db-4467-b6a4-66643be129ca {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:01 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-25212808-e1db-4467-b6a4-66643be129ca Jul 14 21:17:01 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:01 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-25212808-e1db-4467-b6a4-66643be129ca" returned: 0 in 0.578s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-25212808-e1db-4467-b6a4-66643be129ca {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:01 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-25212808-e1db-4467-b6a4-66643be129ca Jul 14 21:17:01 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:01 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-25212808-e1db-4467-b6a4-66643be129ca" returned: 0 in 0.329s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Lock "cinder-quobyte-25212808-e1db-4467-b6a4-66643be129ca" released by "delete_volume" :: held 0.976s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:17:01 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Created reservations ['1fc81392-20b4-45c4-9193-1958df313685', 'c5aadc00-c947-45be-bd16-94d04819df7b', 'd0f084d4-211b-402e-80cf-06408f201c54', '104ab366-8558-4a4d-920a-9f9f6579e677'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:17:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:17:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:17:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:02 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:17:02 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-0a9b60e2-4dce-4462-bf87-6f2ec30d6b2a req-11899b25-378e-4d55-8698-bade25bd53f4 tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-0a9b60e2-4dce-4462-bf87-6f2ec30d6b2a req-11899b25-378e-4d55-8698-bade25bd53f4 tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:02 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe1bde1-3fdc-4d26-b0fa-ac2bb115210e]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:17:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-0a9b60e2-4dce-4462-bf87-6f2ec30d6b2a req-11899b25-378e-4d55-8698-bade25bd53f4 tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:02 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.369s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:02 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:17:02 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Deleted volume successfully. Jul 14 21:17:02 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa Jul 14 21:17:02 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9e434c61-d494-4e39-ba73-919491b93a19 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Lock "cinder-25212808-e1db-4467-b6a4-66643be129ca-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:17:02 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-0a9b60e2-4dce-4462-bf87-6f2ec30d6b2a req-11899b25-378e-4d55-8698-bade25bd53f4 tempest-AttachVolumeTestJSON-1079889311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa" returned: 0 in 0.502s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-0a9b60e2-4dce-4462-bf87-6f2ec30d6b2a req-11899b25-378e-4d55-8698-bade25bd53f4 tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.528s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-0a9b60e2-4dce-4462-bf87-6f2ec30d6b2a req-11899b25-378e-4d55-8698-bade25bd53f4 tempest-AttachVolumeTestJSON-1079889311 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4ffe585-0048-4e43-bba3-b73a27660f3c', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:17:02 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-0a9b60e2-4dce-4462-bf87-6f2ec30d6b2a req-11899b25-378e-4d55-8698-bade25bd53f4 tempest-AttachVolumeTestJSON-1079889311 None] attachment_update completed successfully. Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Flow 'volume_create_manager' (0bdd9072-9f50-4d6f-b244-458340d21a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba564cb-2045-4e44-a9d7-b642d5122d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba564cb-2045-4e44-a9d7-b642d5122d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-5487701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef1c915e-9bde-4fd1-a26a-9b7b08aea929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5f1006065740ffb764a617babd134d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:17:04Z,use_quota=True,user_id='f9cbc01f1790498aaab0aa6e841b51bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416affa0-e9ab-4d69-864c-77e034b2896d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416affa0-e9ab-4d69-864c-77e034b2896d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223601d2-1dbd-4025-8c42-ec47bb23837e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223601d2-1dbd-4025-8c42-ec47bb23837e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef1c915e-9bde-4fd1-a26a-9b7b08aea929', 'volume_name': 'volume-ef1c915e-9bde-4fd1-a26a-9b7b08aea929', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212065e7-7f5c-4d98-ae2f-5fc16d626269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212065e7-7f5c-4d98-ae2f-5fc16d626269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78b1345-c732-453f-8d31-afdb8dec24c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:03 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Volume ef1c915e-9bde-4fd1-a26a-9b7b08aea929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef1c915e-9bde-4fd1-a26a-9b7b08aea929', 'volume_size': 1} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-5487701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef1c915e-9bde-4fd1-a26a-9b7b08aea929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5f1006065740ffb764a617babd134d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:17:04Z,use_quota=True,user_id='f9cbc01f1790498aaab0aa6e841b51bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Creating volume ef1c915e-9bde-4fd1-a26a-9b7b08aea929 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:17:03 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:17:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ef1c915e-9bde-4fd1-a26a-9b7b08aea929 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:04 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ef1c915e-9bde-4fd1-a26a-9b7b08aea929 1073741824 Jul 14 21:17:04 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:04 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ef1c915e-9bde-4fd1-a26a-9b7b08aea929 1073741824" returned: 0 in 0.554s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ef1c915e-9bde-4fd1-a26a-9b7b08aea929 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:04 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ef1c915e-9bde-4fd1-a26a-9b7b08aea929 Jul 14 21:17:04 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:04 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ef1c915e-9bde-4fd1-a26a-9b7b08aea929" returned: 0 in 0.267s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:17:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78b1345-c732-453f-8d31-afdb8dec24c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef1c915e-9bde-4fd1-a26a-9b7b08aea929', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9227e1d-1024-4b06-90dc-f51e185b0fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:04 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Volume volume-ef1c915e-9bde-4fd1-a26a-9b7b08aea929 (ef1c915e-9bde-4fd1-a26a-9b7b08aea929): created successfully Jul 14 21:17:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9227e1d-1024-4b06-90dc-f51e185b0fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Flow 'volume_create_manager' (0bdd9072-9f50-4d6f-b244-458340d21a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:17:04 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d845f10c-c88b-4f19-aad4-e10e7d1bd554 tempest-VolumeQuotasAdminTestJSON-1798867117 None] Created volume successfully. Jul 14 21:17:07 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-5a7b0bbc-3027-4e96-8a30-b82ad86c30e6 tempest-VolumeQuotasAdminTestJSON-1741394115 None] Transfer volume completed successfully. Jul 14 21:17:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] Acquiring lock "cinder-ef1c915e-9bde-4fd1-a26a-9b7b08aea929-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:17:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] Lock "cinder-ef1c915e-9bde-4fd1-a26a-9b7b08aea929-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:17:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] Acquiring lock "cinder-quobyte-ef1c915e-9bde-4fd1-a26a-9b7b08aea929" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:17:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] Lock "cinder-quobyte-ef1c915e-9bde-4fd1-a26a-9b7b08aea929" acquired by "delete_volume" :: waited 0.031s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:17:07 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[84665157-0aa4-4749-8be4-037eb61921df]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:17:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ef1c915e-9bde-4fd1-a26a-9b7b08aea929 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:08 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ef1c915e-9bde-4fd1-a26a-9b7b08aea929 Jul 14 21:17:08 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:08 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ef1c915e-9bde-4fd1-a26a-9b7b08aea929" returned: 0 in 0.602s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ef1c915e-9bde-4fd1-a26a-9b7b08aea929 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:08 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ef1c915e-9bde-4fd1-a26a-9b7b08aea929 Jul 14 21:17:08 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:08 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ef1c915e-9bde-4fd1-a26a-9b7b08aea929" returned: 0 in 0.526s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] Lock "cinder-quobyte-ef1c915e-9bde-4fd1-a26a-9b7b08aea929" released by "delete_volume" :: held 1.207s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:17:09 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] Created reservations ['3337abe4-0243-4795-aa85-33252b1d0320', '7036407a-9be4-41af-8098-09e9d9ef3cfa', 'cc19ff0c-a41b-4587-b647-0bbf785d3ff8', '485bdc60-0b69-4047-8801-987a4dcf534e'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:17:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:17:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:17:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:09 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:17:09 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:09 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.359s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:09 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:17:09 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] Deleted volume successfully. Jul 14 21:17:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5553fccf-ce4f-4824-9819-ea05d5788b07 tempest-VolumeQuotasAdminTestJSON-139643419 None] Lock "cinder-ef1c915e-9bde-4fd1-a26a-9b7b08aea929-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:17:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] Acquiring lock "cinder-879cd95b-0141-4db8-a6b7-034e7e870900-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:17:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] Lock "cinder-879cd95b-0141-4db8-a6b7-034e7e870900-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:17:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] Acquiring lock "cinder-quobyte-879cd95b-0141-4db8-a6b7-034e7e870900" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:17:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] Lock "cinder-quobyte-879cd95b-0141-4db8-a6b7-034e7e870900" acquired by "delete_volume" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:17:16 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[226db58b-ad78-4b94-9445-55bd6e3a6fc2]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:17:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-879cd95b-0141-4db8-a6b7-034e7e870900 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:17 devstack sudo[93514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-879cd95b-0141-4db8-a6b7-034e7e870900 Jul 14 21:17:17 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:17 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-879cd95b-0141-4db8-a6b7-034e7e870900" returned: 0 in 0.552s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-879cd95b-0141-4db8-a6b7-034e7e870900 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:17 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-879cd95b-0141-4db8-a6b7-034e7e870900 Jul 14 21:17:17 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:17 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-879cd95b-0141-4db8-a6b7-034e7e870900" returned: 0 in 0.432s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] Lock "cinder-quobyte-879cd95b-0141-4db8-a6b7-034e7e870900" released by "delete_volume" :: held 1.067s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:17:18 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] Created reservations ['95dec5ff-0201-4a75-a055-52ed3c805c2f', 'b4b1e0ce-bd6e-4bb8-9d0d-3324eda16f06', '26bc58d8-f536-450a-8b43-a254e5736b04', '2894bbe6-391e-4ce4-b43a-caa10a06f11a'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:17:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:17:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:17:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:18 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:17:18 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:18 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.655s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:19 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:17:19 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] Deleted volume successfully. Jul 14 21:17:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ac802ebc-4032-4cf7-aaf4-6c5ddc04221d tempest-TaggedAttachmentsTest-1374571365 None] Lock "cinder-879cd95b-0141-4db8-a6b7-034e7e870900-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:17:28 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=36,cinder:UPDATE=35,cinder:DELETE=4,cinder:INSERT=4 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=31,cinder:UPDATE=37,cinder:INSERT=11,cinder:DELETE=2 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Flow 'volume_create_manager' (5f562bba-6a3d-4929-bad2-6207a6d86014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75c28d5-4222-4270-bdaa-aae95c0cace5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75c28d5-4222-4270-bdaa-aae95c0cace5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-764729209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14d402f-a650-4489-8f9b-08b1e4240660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e70af8a81541878579311845f96c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:17:29Z,use_quota=True,user_id='bb957befa55144ccbd21dc8e94c5f049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(087586cb-29df-45e9-9802-84b2dd598755),volume_type_id=087586cb-29df-45e9-9802-84b2dd598755)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9251cb6-9291-4603-bc1c-f2264e725da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9251cb6-9291-4603-bc1c-f2264e725da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d662654-e2e1-40e1-9d8c-7b13b663f28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d662654-e2e1-40e1-9d8c-7b13b663f28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e14d402f-a650-4489-8f9b-08b1e4240660', 'volume_name': 'volume-e14d402f-a650-4489-8f9b-08b1e4240660', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf714f5-23da-4c9f-a85d-8fb9724ebf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf714f5-23da-4c9f-a85d-8fb9724ebf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a63ae2-61d6-4166-9962-0150971c70f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:29 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Volume e14d402f-a650-4489-8f9b-08b1e4240660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e14d402f-a650-4489-8f9b-08b1e4240660', 'volume_size': 1} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-764729209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14d402f-a650-4489-8f9b-08b1e4240660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e70af8a81541878579311845f96c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:17:29Z,use_quota=True,user_id='bb957befa55144ccbd21dc8e94c5f049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(087586cb-29df-45e9-9802-84b2dd598755),volume_type_id=087586cb-29df-45e9-9802-84b2dd598755)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Creating volume e14d402f-a650-4489-8f9b-08b1e4240660 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:17:29 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:17:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14d402f-a650-4489-8f9b-08b1e4240660 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:29 devstack sudo[93721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14d402f-a650-4489-8f9b-08b1e4240660 1073741824 Jul 14 21:17:29 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:30 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14d402f-a650-4489-8f9b-08b1e4240660 1073741824" returned: 0 in 0.612s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14d402f-a650-4489-8f9b-08b1e4240660 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:30 devstack sudo[93732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14d402f-a650-4489-8f9b-08b1e4240660 Jul 14 21:17:30 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:30 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14d402f-a650-4489-8f9b-08b1e4240660" returned: 0 in 0.335s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:17:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a63ae2-61d6-4166-9962-0150971c70f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e14d402f-a650-4489-8f9b-08b1e4240660', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd686cd2-ed9c-4124-8e5b-6fdea4baad4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:30 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Volume volume-e14d402f-a650-4489-8f9b-08b1e4240660 (e14d402f-a650-4489-8f9b-08b1e4240660): created successfully Jul 14 21:17:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd686cd2-ed9c-4124-8e5b-6fdea4baad4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Flow 'volume_create_manager' (5f562bba-6a3d-4929-bad2-6207a6d86014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:17:30 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-1479d240-8f88-4346-8ce4-dc4c1d362568 tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Created volume successfully. Jul 14 21:17:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cb276419-ae25-49da-9c46-cc10ca57e39d tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cb276419-ae25-49da-9c46-cc10ca57e39d tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cb276419-ae25-49da-9c46-cc10ca57e39d tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:17:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cb276419-ae25-49da-9c46-cc10ca57e39d tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:17:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cb276419-ae25-49da-9c46-cc10ca57e39d tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb276419-ae25-49da-9c46-cc10ca57e39d tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:32 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:17:32 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:33 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb276419-ae25-49da-9c46-cc10ca57e39d tempest-VolumeRetypeWithoutMigrationTest-740988501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.378s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:33 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-cb276419-ae25-49da-9c46-cc10ca57e39d tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:17:33 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-cb276419-ae25-49da-9c46-cc10ca57e39d tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Retype volume completed successfully. Jul 14 21:17:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Acquiring lock "cinder-e14d402f-a650-4489-8f9b-08b1e4240660-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:17:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Lock "cinder-e14d402f-a650-4489-8f9b-08b1e4240660-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:17:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Acquiring lock "cinder-quobyte-e14d402f-a650-4489-8f9b-08b1e4240660" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:17:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Lock "cinder-quobyte-e14d402f-a650-4489-8f9b-08b1e4240660" acquired by "delete_volume" :: waited 0.047s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:17:34 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f60de48-a06e-4085-a4cf-fa86dd407ed1]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:17:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14d402f-a650-4489-8f9b-08b1e4240660 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:34 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14d402f-a650-4489-8f9b-08b1e4240660 Jul 14 21:17:34 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:35 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14d402f-a650-4489-8f9b-08b1e4240660" returned: 0 in 0.585s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14d402f-a650-4489-8f9b-08b1e4240660 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:35 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14d402f-a650-4489-8f9b-08b1e4240660 Jul 14 21:17:35 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Flow 'volume_create_manager' (c243f5db-2d6f-42ba-8fd3-d747b5ba529c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64c7ce9-6268-4939-a236-d9ee8bf3f5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64c7ce9-6268-4939-a236-d9ee8bf3f5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1897174453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9759bf-df5e-4fc8-a611-8464ee920a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1050bf65625743678aeee3a2d5e147ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:17:35Z,use_quota=True,user_id='559630429a564c77843d2bff2bb95355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d76d230-06bd-42e0-a0e3-a06846fa8d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d76d230-06bd-42e0-a0e3-a06846fa8d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c788f2-32be-43d3-96fd-f11b2fcd7a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c788f2-32be-43d3-96fd-f11b2fcd7a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b9759bf-df5e-4fc8-a611-8464ee920a44', 'volume_name': 'volume-3b9759bf-df5e-4fc8-a611-8464ee920a44', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc455f5a-6c52-4873-80dc-29ad3f5b7a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc455f5a-6c52-4873-80dc-29ad3f5b7a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786e0f1d-741d-43c4-97a8-9e030cc01d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:35 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Volume 3b9759bf-df5e-4fc8-a611-8464ee920a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b9759bf-df5e-4fc8-a611-8464ee920a44', 'volume_size': 1} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1897174453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9759bf-df5e-4fc8-a611-8464ee920a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1050bf65625743678aeee3a2d5e147ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:17:35Z,use_quota=True,user_id='559630429a564c77843d2bff2bb95355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Creating volume 3b9759bf-df5e-4fc8-a611-8464ee920a44 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:17:35 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b9759bf-df5e-4fc8-a611-8464ee920a44 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:35 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b9759bf-df5e-4fc8-a611-8464ee920a44 1073741824 Jul 14 21:17:35 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:35 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14d402f-a650-4489-8f9b-08b1e4240660" returned: 0 in 0.859s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Lock "cinder-quobyte-e14d402f-a650-4489-8f9b-08b1e4240660" released by "delete_volume" :: held 1.541s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:17:36 devstack cinder-volume[88300]: WARNING cinder.quota [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:17:36 devstack cinder-volume[88300]: WARNING cinder.quota [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Created reservations ['67949772-fc5f-48f9-8c1d-de6fef5e4d46', '231730ae-9c54-4adb-8288-b6ab4d86bc6d', '0f583b5c-82db-4737-8862-3e230dd3dcf5', '93eeff63-450a-4492-94ec-f71f17967d24'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:36 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:17:36 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:36 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b9759bf-df5e-4fc8-a611-8464ee920a44 1073741824" returned: 0 in 0.911s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:36 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:17:36 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b9759bf-df5e-4fc8-a611-8464ee920a44 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:36 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b9759bf-df5e-4fc8-a611-8464ee920a44 Jul 14 21:17:36 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:36 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.563s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:17:36 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Deleted volume successfully. Jul 14 21:17:36 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-32af5ad5-32bb-4b3f-8aec-6bf6e121d0cb tempest-VolumeRetypeWithoutMigrationTest-740988501 None] Lock "cinder-e14d402f-a650-4489-8f9b-08b1e4240660-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:17:37 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.572s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:37 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:17:37 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b9759bf-df5e-4fc8-a611-8464ee920a44" returned: 0 in 0.670s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:17:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786e0f1d-741d-43c4-97a8-9e030cc01d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b9759bf-df5e-4fc8-a611-8464ee920a44', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a68d01-a15e-47f0-b7fa-805d8a0dfc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:37 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Volume volume-3b9759bf-df5e-4fc8-a611-8464ee920a44 (3b9759bf-df5e-4fc8-a611-8464ee920a44): created successfully Jul 14 21:17:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a68d01-a15e-47f0-b7fa-805d8a0dfc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Flow 'volume_create_manager' (c243f5db-2d6f-42ba-8fd3-d747b5ba529c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:17:37 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-52a8a12e-0900-4511-be85-498b52e61b2f tempest-ServerRescueNegativeTestJSON-698492840 None] Created volume successfully. Jul 14 21:17:39 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-355900a3-6e68-4cde-80f1-4c50a105616e req-fc889c23-9e64-46b3-9910-c4d66f3b83d2 tempest-AttachVolumeTestJSON-1079889311 None] Terminate volume connection completed successfully. Jul 14 21:17:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-355900a3-6e68-4cde-80f1-4c50a105616e req-fc889c23-9e64-46b3-9910-c4d66f3b83d2 tempest-AttachVolumeTestJSON-1079889311 None] Deleting attachment e4ffe585-0048-4e43-bba3-b73a27660f3c. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Flow 'volume_create_manager' (72951a5e-16a3-41e5-b6f7-9852ca1715d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6bc780-c0d0-455c-9699-950d075ac1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6bc780-c0d0-455c-9699-950d075ac1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1424156045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c348e4-1445-461d-8e2b-2fb122e7c13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ffd90a3a0d447aaa74b045cf486bdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:17:43Z,use_quota=True,user_id='abfc0e2b02984c91928cf7c914159c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5d1b42-bf62-414b-ab3f-d573a80bbcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5d1b42-bf62-414b-ab3f-d573a80bbcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a31549-79c6-45b3-9d89-15908d7931dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a31549-79c6-45b3-9d89-15908d7931dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81c348e4-1445-461d-8e2b-2fb122e7c13a', 'volume_name': 'volume-81c348e4-1445-461d-8e2b-2fb122e7c13a', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1105a1-ac69-42dc-85fa-45bef0234951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1105a1-ac69-42dc-85fa-45bef0234951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d509673-1fa4-46eb-801f-f884c870e6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:43 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Volume 81c348e4-1445-461d-8e2b-2fb122e7c13a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81c348e4-1445-461d-8e2b-2fb122e7c13a', 'volume_size': 1} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1424156045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c348e4-1445-461d-8e2b-2fb122e7c13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ffd90a3a0d447aaa74b045cf486bdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:17:43Z,use_quota=True,user_id='abfc0e2b02984c91928cf7c914159c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Creating volume 81c348e4-1445-461d-8e2b-2fb122e7c13a {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:17:43 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:17:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:43 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a 1073741824 Jul 14 21:17:43 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:44 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a 1073741824" returned: 0 in 0.951s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:44 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a Jul 14 21:17:44 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:45 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a" returned: 0 in 0.529s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:45 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:17:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d509673-1fa4-46eb-801f-f884c870e6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81c348e4-1445-461d-8e2b-2fb122e7c13a', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c432f7f-c8ee-4aea-965c-e3ad86aad7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:45 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Volume volume-81c348e4-1445-461d-8e2b-2fb122e7c13a (81c348e4-1445-461d-8e2b-2fb122e7c13a): created successfully Jul 14 21:17:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c432f7f-c8ee-4aea-965c-e3ad86aad7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Flow 'volume_create_manager' (72951a5e-16a3-41e5-b6f7-9852ca1715d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:17:45 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-2392f64a-7883-4561-9b97-5f8efeaf25a7 req-2e9bc196-d1b3-48a1-9986-0029573499d4 tempest-VolumesSnapshotsTestJSON-2103648008 None] Created volume successfully. Jul 14 21:17:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] Creating offline snapshot 299e14b6-f071-404e-9abf-85fa26521db6 of volume 81c348e4-1445-461d-8e2b-2fb122e7c13a {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:17:47 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[824e13d3-4c36-4e07-812a-6e18797a6ccf]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:17:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:47 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a Jul 14 21:17:47 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:47 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a" returned: 0 in 0.845s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:48 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6 1G Jul 14 21:17:48 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:48 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6 1G" returned: 0 in 0.809s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81c348e4-1445-461d-8e2b-2fb122e7c13a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:48 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81c348e4-1445-461d-8e2b-2fb122e7c13a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6 Jul 14 21:17:48 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:49 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81c348e4-1445-461d-8e2b-2fb122e7c13a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6" returned: 0 in 0.534s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:49 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6 is being set with open permissions: ugo+rw Jul 14 21:17:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:49 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6 Jul 14 21:17:49 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:49 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6" returned: 0 in 0.445s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:49 devstack sudo[94076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.info Jul 14 21:17:49 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:50 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.info" returned: 0 in 0.437s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:50 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.info is being set with open permissions: ugo+rw Jul 14 21:17:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:50 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.info Jul 14 21:17:50 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:50 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.info" returned: 0 in 0.549s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.948s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:51 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-5873101d-5c17-4400-b693-86085989fae1 req-05f249dc-0173-4d2b-a868-862a3961cf8b tempest-VolumesSnapshotsTestJSON-2103648008 None] Create snapshot completed successfully Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] Acquiring lock "cinder-3b9759bf-df5e-4fc8-a611-8464ee920a44-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] Lock "cinder-3b9759bf-df5e-4fc8-a611-8464ee920a44-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] Acquiring lock "cinder-quobyte-3b9759bf-df5e-4fc8-a611-8464ee920a44" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] Lock "cinder-quobyte-3b9759bf-df5e-4fc8-a611-8464ee920a44" acquired by "delete_volume" :: waited 0.054s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[105051ba-3c0b-44f6-92e9-91fb5c92a0a7]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b9759bf-df5e-4fc8-a611-8464ee920a44 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Acquiring lock "cinder-299e14b6-f071-404e-9abf-85fa26521db6-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "cinder-299e14b6-f071-404e-9abf-85fa26521db6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Acquiring lock "cinder-quobyte-81c348e4-1445-461d-8e2b-2fb122e7c13a" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:17:51 devstack sudo[94084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b9759bf-df5e-4fc8-a611-8464ee920a44 Jul 14 21:17:51 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "cinder-quobyte-81c348e4-1445-461d-8e2b-2fb122e7c13a" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Acquiring lock "cinder-quobyte-299e14b6-f071-404e-9abf-85fa26521db6" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "cinder-quobyte-299e14b6-f071-404e-9abf-85fa26521db6" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Deleting offline snapshot 299e14b6-f071-404e-9abf-85fa26521db6 of volume 81c348e4-1445-461d-8e2b-2fb122e7c13a {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] snapshot_file for this snap is: volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[79712dcd-d267-4bb2-9a16-387856d6eeed]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:51 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6 Jul 14 21:17:51 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:51 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b9759bf-df5e-4fc8-a611-8464ee920a44" returned: 0 in 0.592s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b9759bf-df5e-4fc8-a611-8464ee920a44 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:52 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b9759bf-df5e-4fc8-a611-8464ee920a44 Jul 14 21:17:52 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:52 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6" returned: 0 in 0.656s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81c348e4-1445-461d-8e2b-2fb122e7c13a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:17:52 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6a6f1d-c956-4c63-ac2b-070f95ff3830]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:17:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:52 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b9759bf-df5e-4fc8-a611-8464ee920a44" returned: 0 in 0.532s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] Lock "cinder-quobyte-3b9759bf-df5e-4fc8-a611-8464ee920a44" released by "delete_volume" :: held 1.239s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:17:52 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a Jul 14 21:17:52 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:52 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] Created reservations ['794ed893-9569-4295-9fe9-cc7594e3ccbf', '33e691cc-ecf0-4585-9f63-70454eefb9c4', 'ed92e5e8-8d20-450f-87c4-dd58a74cf2be', '1f620e7e-93c1-4cd4-9b14-940727e922f6'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:17:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:17:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:17:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:52 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:17:52 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:53 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a" returned: 0 in 0.637s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:53 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6 Jul 14 21:17:53 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:53 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.437s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:53 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:17:53 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] Deleted volume successfully. Jul 14 21:17:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f1878def-428d-46a1-96fa-6485ff997470 tempest-ServerRescueNegativeTestJSON-698492840 None] Lock "cinder-3b9759bf-df5e-4fc8-a611-8464ee920a44-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:17:53 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6" returned: 0 in 0.496s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:53 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6 Jul 14 21:17:53 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:54 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a.299e14b6-f071-404e-9abf-85fa26521db6" returned: 0 in 0.661s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "cinder-quobyte-299e14b6-f071-404e-9abf-85fa26521db6" released by "_delete_snapshot" :: held 2.862s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:17:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "cinder-quobyte-81c348e4-1445-461d-8e2b-2fb122e7c13a" released by "delete_snapshot" :: held 2.923s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:17:54 devstack cinder-volume[88300]: WARNING cinder.quota [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:17:54 devstack cinder-volume[88300]: DEBUG cinder.quota [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Created reservations ['4f9478f5-a57c-40d7-9e3d-9cacf73c46d6', '574d141c-84b8-4ff4-880c-3cde656a154a', '68ef3581-f3c7-4f7d-92e9-c01c21a661ac', '14cf029a-c686-4252-a99d-a9b4adf11dd3'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:17:54 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Delete snapshot completed successfully. Jul 14 21:17:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-efbd98d7-bef5-4356-83f2-230c309ce7f3 req-057c981e-7534-4d34-a0d4-68736c7c7404 tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "cinder-299e14b6-f071-404e-9abf-85fa26521db6-delete_snapshot" released by "delete_snapshot" :: held 3.266s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:17:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] Acquiring lock "cinder-81c348e4-1445-461d-8e2b-2fb122e7c13a-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:17:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "cinder-81c348e4-1445-461d-8e2b-2fb122e7c13a-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:17:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] Acquiring lock "cinder-quobyte-81c348e4-1445-461d-8e2b-2fb122e7c13a" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:17:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "cinder-quobyte-81c348e4-1445-461d-8e2b-2fb122e7c13a" acquired by "delete_volume" :: waited 0.032s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:17:55 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2387f1-ad31-4d4d-8aa8-cb2443b84f3f]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:17:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:55 devstack sudo[94145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a Jul 14 21:17:55 devstack sudo[94145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:56 devstack sudo[94145]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a" returned: 0 in 0.708s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:56 devstack sudo[94152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a Jul 14 21:17:56 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:56 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-81c348e4-1445-461d-8e2b-2fb122e7c13a" returned: 0 in 0.591s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "cinder-quobyte-81c348e4-1445-461d-8e2b-2fb122e7c13a" released by "delete_volume" :: held 1.433s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:17:57 devstack cinder-volume[88300]: DEBUG cinder.quota [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] Created reservations ['58b423f9-b333-4ed0-af64-c2fa22b59683', '430400e5-9582-4fb8-949e-67cdd70ebcbc', '76e81a96-bb9e-4c37-a936-7d69403501e6', '88723d88-e10e-477d-a50f-1d8821fddcec'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:17:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:17:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:17:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:57 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:17:57 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:57 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.387s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:57 devstack cinder-volume[88300]: DEBUG cinder.manager [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:17:57 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] Deleted volume successfully. Jul 14 21:17:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-d34f6549-95c7-42d7-876c-1116016f6f55 req-cbee7adb-bd26-4b5c-8188-7c2fb538501b tempest-VolumesSnapshotsTestJSON-2103648008 None] Lock "cinder-81c348e4-1445-461d-8e2b-2fb122e7c13a-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Flow 'volume_create_manager' (8f15a163-137a-4b37-b7a0-52c3a47e20d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f8e90d-ee5c-4139-994c-4cb0c37c42a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f8e90d-ee5c-4139-994c-4cb0c37c42a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-335581775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4cfb41-ee3e-48b2-85f1-7972675753f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73afa2ac0a554113bb7d1936711d1a2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:17:58Z,use_quota=True,user_id='d26ddf4051b041ec991256de800b9b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70afe11-5486-4756-8d40-e2a6f8e9ec5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70afe11-5486-4756-8d40-e2a6f8e9ec5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8150b4dd-3b9d-474c-8cf8-bf9380172d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8150b4dd-3b9d-474c-8cf8-bf9380172d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af4cfb41-ee3e-48b2-85f1-7972675753f7', 'volume_name': 'volume-af4cfb41-ee3e-48b2-85f1-7972675753f7', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a80104-7291-41ec-9a66-4248008989dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a80104-7291-41ec-9a66-4248008989dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3996000b-2bf2-484a-83cf-138807721172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:58 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Volume af4cfb41-ee3e-48b2-85f1-7972675753f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af4cfb41-ee3e-48b2-85f1-7972675753f7', 'volume_size': 1} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-335581775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4cfb41-ee3e-48b2-85f1-7972675753f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73afa2ac0a554113bb7d1936711d1a2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:17:58Z,use_quota=True,user_id='d26ddf4051b041ec991256de800b9b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Creating volume af4cfb41-ee3e-48b2-85f1-7972675753f7 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:17:58 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:17:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:58 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7 1073741824 Jul 14 21:17:58 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:59 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7 1073741824" returned: 0 in 0.892s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:17:59 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7 Jul 14 21:17:59 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:17:59 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Jul 14 21:17:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7" returned: 0 in 0.291s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:17:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:17:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:17:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3996000b-2bf2-484a-83cf-138807721172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af4cfb41-ee3e-48b2-85f1-7972675753f7', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743d3c71-4196-465d-8d48-86d49f8650bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:17:59 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Volume volume-af4cfb41-ee3e-48b2-85f1-7972675753f7 (af4cfb41-ee3e-48b2-85f1-7972675753f7): created successfully Jul 14 21:17:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743d3c71-4196-465d-8d48-86d49f8650bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:17:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Flow 'volume_create_manager' (8f15a163-137a-4b37-b7a0-52c3a47e20d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:17:59 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f0c71103-27ee-4db4-8460-65090a811ee4 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Created volume successfully. Jul 14 21:18:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Creating offline snapshot fa35ba6c-af13-44c5-a823-b592ef8177af of volume af4cfb41-ee3e-48b2-85f1-7972675753f7 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:18:00 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[433a4cb7-e3e3-445a-9e14-ae2e8419fe4a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:18:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:01 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7 Jul 14 21:18:01 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:01 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7" returned: 0 in 0.451s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:01 devstack sudo[94199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af 1G Jul 14 21:18:01 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:01 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af 1G" returned: 0 in 0.552s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af4cfb41-ee3e-48b2-85f1-7972675753f7 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:01 devstack sudo[94207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af4cfb41-ee3e-48b2-85f1-7972675753f7 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af Jul 14 21:18:01 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:02 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af4cfb41-ee3e-48b2-85f1-7972675753f7 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af" returned: 0 in 0.466s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:02 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af is being set with open permissions: ugo+rw Jul 14 21:18:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:02 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af Jul 14 21:18:02 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:02 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af" returned: 0 in 0.348s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:02 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.info Jul 14 21:18:02 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:03 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.info" returned: 0 in 0.470s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:03 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.info is being set with open permissions: ugo+rw Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:03 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.info Jul 14 21:18:03 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Flow 'volume_create_manager' (4d618f93-ec93-4bbf-9d92-1eb9ff715fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3234a9d9-3073-45a5-9edf-cb6a833c6b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3234a9d9-3073-45a5-9edf-cb6a833c6b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2041571472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ef00de-94e9-4005-b2bc-b8c72679c277,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04000675a718432eb4dbb4e460b7fcbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:18:03Z,use_quota=True,user_id='63f538689cfc447e8c1ba639d9571929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc5e92a-f08a-4f04-b4b3-b9c27fdfe2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc5e92a-f08a-4f04-b4b3-b9c27fdfe2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e873b424-1bb7-4aa7-85bc-b72075ff2d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:03 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e873b424-1bb7-4aa7-85bc-b72075ff2d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49ef00de-94e9-4005-b2bc-b8c72679c277', 'volume_name': 'volume-49ef00de-94e9-4005-b2bc-b8c72679c277', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e5f69b-2056-4377-ab8d-7a65d2aae3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e5f69b-2056-4377-ab8d-7a65d2aae3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c377a25-80bf-4e98-93e1-ea0e923ba358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:03 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Volume 49ef00de-94e9-4005-b2bc-b8c72679c277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49ef00de-94e9-4005-b2bc-b8c72679c277', 'volume_size': 1} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.info" returned: 0 in 0.358s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.778s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.029s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2041571472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ef00de-94e9-4005-b2bc-b8c72679c277,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04000675a718432eb4dbb4e460b7fcbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:18:03Z,use_quota=True,user_id='63f538689cfc447e8c1ba639d9571929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Creating volume 49ef00de-94e9-4005-b2bc-b8c72679c277 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:18:03 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:18:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-49ef00de-94e9-4005-b2bc-b8c72679c277 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:03 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-49ef00de-94e9-4005-b2bc-b8c72679c277 1073741824 Jul 14 21:18:03 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:03 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-b7f92332-23d7-4b06-b46c-0f1d13ab5289 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Create snapshot completed successfully Jul 14 21:18:04 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-49ef00de-94e9-4005-b2bc-b8c72679c277 1073741824" returned: 0 in 0.520s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-49ef00de-94e9-4005-b2bc-b8c72679c277 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:04 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-49ef00de-94e9-4005-b2bc-b8c72679c277 Jul 14 21:18:04 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:04 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-49ef00de-94e9-4005-b2bc-b8c72679c277" returned: 0 in 0.318s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c377a25-80bf-4e98-93e1-ea0e923ba358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49ef00de-94e9-4005-b2bc-b8c72679c277', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe496684-4e2c-444f-9f02-fec079c82ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:04 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Volume volume-49ef00de-94e9-4005-b2bc-b8c72679c277 (49ef00de-94e9-4005-b2bc-b8c72679c277): created successfully Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe496684-4e2c-444f-9f02-fec079c82ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Flow 'volume_create_manager' (4d618f93-ec93-4bbf-9d92-1eb9ff715fdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:18:04 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-98fb6a18-18de-4205-b7a5-ff636499a5a8 tempest-VolumesTestJSON-216075990 None] Created volume successfully. Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Acquiring lock "cinder-fa35ba6c-af13-44c5-a823-b592ef8177af-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "cinder-fa35ba6c-af13-44c5-a823-b592ef8177af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Acquiring lock "cinder-quobyte-af4cfb41-ee3e-48b2-85f1-7972675753f7" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "cinder-quobyte-af4cfb41-ee3e-48b2-85f1-7972675753f7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Acquiring lock "cinder-quobyte-fa35ba6c-af13-44c5-a823-b592ef8177af" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "cinder-quobyte-fa35ba6c-af13-44c5-a823-b592ef8177af" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Deleting offline snapshot fa35ba6c-af13-44c5-a823-b592ef8177af of volume af4cfb41-ee3e-48b2-85f1-7972675753f7 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] snapshot_file for this snap is: volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[8710a3cc-e288-4770-a6ea-5e0b9beb8a30]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:18:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:04 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af Jul 14 21:18:04 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:05 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af" returned: 0 in 0.463s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af4cfb41-ee3e-48b2-85f1-7972675753f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:18:05 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8c60e9-73cf-437f-ad02-21a275ea18be]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:18:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:05 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7 Jul 14 21:18:05 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:05 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7" returned: 0 in 0.444s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:05 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af Jul 14 21:18:05 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:06 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af" returned: 0 in 0.463s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:06 devstack sudo[94259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af Jul 14 21:18:06 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Flow 'volume_create_manager' (b43790cb-7e6c-4fcf-aead-8d577176d48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66165c08-da68-45d9-abf6-dbe196e4c591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66165c08-da68-45d9-abf6-dbe196e4c591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-823938439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5117283-2da4-4b5e-bba5-70c7316bb463,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04000675a718432eb4dbb4e460b7fcbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:18:06Z,use_quota=True,user_id='63f538689cfc447e8c1ba639d9571929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e68d1c-289a-478c-bdd9-d9414d5cf0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e68d1c-289a-478c-bdd9-d9414d5cf0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f21bd2-0305-4da9-9f80-006546c8b4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f21bd2-0305-4da9-9f80-006546c8b4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5117283-2da4-4b5e-bba5-70c7316bb463', 'volume_name': 'volume-d5117283-2da4-4b5e-bba5-70c7316bb463', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064fb250-b294-44f5-9930-7b004481d79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064fb250-b294-44f5-9930-7b004481d79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23be8b6-b898-4712-b846-60258025de5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:06 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Volume d5117283-2da4-4b5e-bba5-70c7316bb463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5117283-2da4-4b5e-bba5-70c7316bb463', 'volume_size': 1} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-823938439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5117283-2da4-4b5e-bba5-70c7316bb463,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04000675a718432eb4dbb4e460b7fcbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:18:06Z,use_quota=True,user_id='63f538689cfc447e8c1ba639d9571929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Creating volume d5117283-2da4-4b5e-bba5-70c7316bb463 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:18:06 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d5117283-2da4-4b5e-bba5-70c7316bb463 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:06 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d5117283-2da4-4b5e-bba5-70c7316bb463 1073741824 Jul 14 21:18:06 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:06 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7.fa35ba6c-af13-44c5-a823-b592ef8177af" returned: 0 in 0.290s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "cinder-quobyte-fa35ba6c-af13-44c5-a823-b592ef8177af" released by "_delete_snapshot" :: held 1.778s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "cinder-quobyte-af4cfb41-ee3e-48b2-85f1-7972675753f7" released by "delete_snapshot" :: held 1.801s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Created reservations ['8228b431-f664-4c33-80ca-655526b7853f', 'c7f50d17-e8d0-44d3-a200-55eb06b10322', '29544029-f967-4feb-a20a-92947a0edfef', '28675611-0d3d-4aec-9c3c-f4882cdd59eb'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:18:06 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Delete snapshot completed successfully. Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12b2bca0-400b-4a8c-a1c1-f85a3ed7ac22 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "cinder-fa35ba6c-af13-44c5-a823-b592ef8177af-delete_snapshot" released by "delete_snapshot" :: held 1.983s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:18:06 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d5117283-2da4-4b5e-bba5-70c7316bb463 1073741824" returned: 0 in 0.488s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d5117283-2da4-4b5e-bba5-70c7316bb463 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:06 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d5117283-2da4-4b5e-bba5-70c7316bb463 Jul 14 21:18:06 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Acquiring lock "cinder-af4cfb41-ee3e-48b2-85f1-7972675753f7-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "cinder-af4cfb41-ee3e-48b2-85f1-7972675753f7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Acquiring lock "cinder-quobyte-af4cfb41-ee3e-48b2-85f1-7972675753f7" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "cinder-quobyte-af4cfb41-ee3e-48b2-85f1-7972675753f7" acquired by "delete_volume" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f44cf4-30a9-464c-bbfc-6687c9b19b75]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:07 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d5117283-2da4-4b5e-bba5-70c7316bb463" returned: 0 in 0.320s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23be8b6-b898-4712-b846-60258025de5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5117283-2da4-4b5e-bba5-70c7316bb463', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2508af9-7517-42f6-8da1-91625e9954da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:07 devstack sudo[94270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7 Jul 14 21:18:07 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:07 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Volume volume-d5117283-2da4-4b5e-bba5-70c7316bb463 (d5117283-2da4-4b5e-bba5-70c7316bb463): created successfully Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2508af9-7517-42f6-8da1-91625e9954da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Flow 'volume_create_manager' (b43790cb-7e6c-4fcf-aead-8d577176d48e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:18:07 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-17429a9c-dfcf-4a3e-9001-2feee1eb32a0 tempest-VolumesTestJSON-216075990 None] Created volume successfully. Jul 14 21:18:07 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7" returned: 0 in 0.405s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:07 devstack sudo[94276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7 Jul 14 21:18:07 devstack sudo[94276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:07 devstack sudo[94276]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-af4cfb41-ee3e-48b2-85f1-7972675753f7" returned: 0 in 0.259s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "cinder-quobyte-af4cfb41-ee3e-48b2-85f1-7972675753f7" released by "delete_volume" :: held 0.727s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Created reservations ['3799a906-0faa-4b0b-8201-eb04a0b898bf', 'e7f6c464-2a65-41af-93f4-0aadfa84129d', 'aad9a433-920f-476f-b59b-50aef17e73c5', 'e15cd6ec-e30a-4c9e-abe2-b8e29c110b7e'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:07 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:18:07 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:08 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.270s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:18:08 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Deleted volume successfully. Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e07d699d-f445-4878-80d6-3424d18be204 tempest-VolumeSnapshotQuotasNegativeTestJSON-558285548 None] Lock "cinder-af4cfb41-ee3e-48b2-85f1-7972675753f7-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Flow 'volume_create_manager' (30d3f332-6a64-4a24-a2cc-d903b8da7d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f06302e-35be-4f73-b288-e4ee40f55d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f06302e-35be-4f73-b288-e4ee40f55d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-664792158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602da018-189e-45dd-9019-04e894f50b77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04000675a718432eb4dbb4e460b7fcbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:18:09Z,use_quota=True,user_id='63f538689cfc447e8c1ba639d9571929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121c6d6a-3b2e-4339-a45c-99241ffceef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121c6d6a-3b2e-4339-a45c-99241ffceef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d6fc584-38cc-4616-9705-0fbb1bfd85fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d6fc584-38cc-4616-9705-0fbb1bfd85fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602da018-189e-45dd-9019-04e894f50b77', 'volume_name': 'volume-602da018-189e-45dd-9019-04e894f50b77', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed697f6-9009-4121-9e13-677c17802922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed697f6-9009-4121-9e13-677c17802922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc040768-cbae-4649-b062-53d300b4c235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:08 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Volume 602da018-189e-45dd-9019-04e894f50b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602da018-189e-45dd-9019-04e894f50b77', 'volume_size': 1} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-664792158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602da018-189e-45dd-9019-04e894f50b77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='04000675a718432eb4dbb4e460b7fcbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:18:09Z,use_quota=True,user_id='63f538689cfc447e8c1ba639d9571929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Creating volume 602da018-189e-45dd-9019-04e894f50b77 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:18:08 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:18:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-602da018-189e-45dd-9019-04e894f50b77 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:08 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-602da018-189e-45dd-9019-04e894f50b77 1073741824 Jul 14 21:18:08 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:09 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-602da018-189e-45dd-9019-04e894f50b77 1073741824" returned: 0 in 0.529s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-602da018-189e-45dd-9019-04e894f50b77 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:09 devstack sudo[94288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-602da018-189e-45dd-9019-04e894f50b77 Jul 14 21:18:09 devstack sudo[94288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:09 devstack sudo[94288]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-602da018-189e-45dd-9019-04e894f50b77" returned: 0 in 0.308s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:18:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc040768-cbae-4649-b062-53d300b4c235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602da018-189e-45dd-9019-04e894f50b77', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a29ad5-d00b-49d5-a581-afb07634fec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:09 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Volume volume-602da018-189e-45dd-9019-04e894f50b77 (602da018-189e-45dd-9019-04e894f50b77): created successfully Jul 14 21:18:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a29ad5-d00b-49d5-a581-afb07634fec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Flow 'volume_create_manager' (30d3f332-6a64-4a24-a2cc-d903b8da7d4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:18:09 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-b5430119-47c1-4297-9a6c-b47489708088 tempest-VolumesTestJSON-216075990 None] Created volume successfully. Jul 14 21:18:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] Acquiring lock "cinder-602da018-189e-45dd-9019-04e894f50b77-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] Lock "cinder-602da018-189e-45dd-9019-04e894f50b77-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] Acquiring lock "cinder-quobyte-602da018-189e-45dd-9019-04e894f50b77" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] Lock "cinder-quobyte-602da018-189e-45dd-9019-04e894f50b77" acquired by "delete_volume" :: waited 0.016s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:12 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[667378d2-22b2-4881-b7d0-2e2d419e7901]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:18:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-602da018-189e-45dd-9019-04e894f50b77 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:12 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-602da018-189e-45dd-9019-04e894f50b77 Jul 14 21:18:12 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:13 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-602da018-189e-45dd-9019-04e894f50b77" returned: 0 in 0.419s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-602da018-189e-45dd-9019-04e894f50b77 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:13 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-602da018-189e-45dd-9019-04e894f50b77 Jul 14 21:18:13 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:13 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-602da018-189e-45dd-9019-04e894f50b77" returned: 0 in 0.261s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] Lock "cinder-quobyte-602da018-189e-45dd-9019-04e894f50b77" released by "delete_volume" :: held 0.728s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] Created reservations ['ad62b2c0-8eb6-4240-affd-f1e7d765a609', '29a955e9-f924-4568-b40a-aef1dbe8ce52', 'e628bfa1-1829-4c95-a081-4ae041de059a', '8cedc63d-b20b-4b7d-915d-a1de883ab4d6'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:13 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:18:13 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] Acquiring lock "cinder-d5117283-2da4-4b5e-bba5-70c7316bb463-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] Lock "cinder-d5117283-2da4-4b5e-bba5-70c7316bb463-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] Acquiring lock "cinder-quobyte-d5117283-2da4-4b5e-bba5-70c7316bb463" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:13 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] Lock "cinder-quobyte-d5117283-2da4-4b5e-bba5-70c7316bb463" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.356s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:18:13 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] Deleted volume successfully. Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffff50f-26b0-4fb6-a052-2bcaef2c9dcf]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d5117283-2da4-4b5e-bba5-70c7316bb463 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ab112708-706e-429d-973a-64f95ba6da61 tempest-VolumesTestJSON-216075990 None] Lock "cinder-602da018-189e-45dd-9019-04e894f50b77-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:18:14 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d5117283-2da4-4b5e-bba5-70c7316bb463 Jul 14 21:18:14 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:14 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d5117283-2da4-4b5e-bba5-70c7316bb463" returned: 0 in 0.509s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d5117283-2da4-4b5e-bba5-70c7316bb463 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:14 devstack sudo[94315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d5117283-2da4-4b5e-bba5-70c7316bb463 Jul 14 21:18:14 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:14 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d5117283-2da4-4b5e-bba5-70c7316bb463" returned: 0 in 0.266s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] Lock "cinder-quobyte-d5117283-2da4-4b5e-bba5-70c7316bb463" released by "delete_volume" :: held 0.833s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:18:14 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] Created reservations ['3439304a-7d97-402e-9b23-c44085581ca1', '1d82b76e-d4f1-42e8-a752-6cc8db5853e0', '3e57539b-b471-4f5a-aae0-7566bf9f594a', '4f372ceb-f72c-4a7b-b5b2-1bb627392391'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:18:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:18:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:18:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:14 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:18:14 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] Acquiring lock "cinder-49ef00de-94e9-4005-b2bc-b8c72679c277-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] Lock "cinder-49ef00de-94e9-4005-b2bc-b8c72679c277-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] Acquiring lock "cinder-quobyte-49ef00de-94e9-4005-b2bc-b8c72679c277" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] Lock "cinder-quobyte-49ef00de-94e9-4005-b2bc-b8c72679c277" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:15 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39ec4a4-788b-4e7a-a92f-a66b8db14a45]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:18:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-49ef00de-94e9-4005-b2bc-b8c72679c277 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:15 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.400s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:15 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:18:15 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] Deleted volume successfully. Jul 14 21:18:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5fc1e931-6a64-41af-bd98-b3cdba20bb2c tempest-VolumesTestJSON-216075990 None] Lock "cinder-d5117283-2da4-4b5e-bba5-70c7316bb463-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:18:15 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-49ef00de-94e9-4005-b2bc-b8c72679c277 Jul 14 21:18:15 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:15 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-49ef00de-94e9-4005-b2bc-b8c72679c277" returned: 0 in 0.523s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-49ef00de-94e9-4005-b2bc-b8c72679c277 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:15 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-49ef00de-94e9-4005-b2bc-b8c72679c277 Jul 14 21:18:15 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:15 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-49ef00de-94e9-4005-b2bc-b8c72679c277" returned: 0 in 0.265s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] Lock "cinder-quobyte-49ef00de-94e9-4005-b2bc-b8c72679c277" released by "delete_volume" :: held 0.854s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:18:16 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] Created reservations ['f68c6852-bdb5-4fb3-9cd4-0e7da70be0f5', 'b977125b-86db-49fe-961b-f29415aa832d', '75389ec6-14d7-4bac-b4d3-6cf6cc6726e1', '2e24f9b9-4bb5-4735-bd60-7682e1569fe2'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:18:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:18:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:18:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:16 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:18:16 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:16 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.291s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:16 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:18:16 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] Deleted volume successfully. Jul 14 21:18:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-03bc5444-0988-41d6-b27d-ee0c96f246c7 tempest-VolumesTestJSON-216075990 None] Lock "cinder-49ef00de-94e9-4005-b2bc-b8c72679c277-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:18:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e42147da-2ceb-4946-8168-e8e1ee27a0b2 tempest-BackendsCapabilitiesAdminTestsJSON-1921716780 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88300) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 14 21:18:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-65e67a32-a183-442a-8f1c-fea7489eb4a0 tempest-BackendsCapabilitiesAdminTestsJSON-1921716780 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88300) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 14 21:18:26 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:UPDATE=88,cinder:SELECT=73,cinder:INSERT=26,cinder:DELETE=10 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:18:26 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=78,cinder:UPDATE=104,cinder:INSERT=19,cinder:DELETE=6 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Flow 'volume_create_manager' (67b51c13-1ff9-4ffc-855d-b0f0a7cfc8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b29d4ff-8f18-40da-9ba5-d6c2b826e2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b29d4ff-8f18-40da-9ba5-d6c2b826e2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-302620463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f23a01-38c9-47ed-af98-82985d6b1c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39dc87def7d2461d89142f5d2d0e505c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:18:29Z,use_quota=True,user_id='e052d621ac9f4cc294b954b74b69f361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0124e2bd-3d83-4af3-9944-b65cde654deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0124e2bd-3d83-4af3-9944-b65cde654deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2152083a-64f0-45ad-a13a-8c5e5de1ba67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2152083a-64f0-45ad-a13a-8c5e5de1ba67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9f23a01-38c9-47ed-af98-82985d6b1c9e', 'volume_name': 'volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ee1382-6b9e-44ab-a167-515c010cac70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ee1382-6b9e-44ab-a167-515c010cac70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e4e853-83ae-465d-9c9f-5cbb14bc646e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:29 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Volume f9f23a01-38c9-47ed-af98-82985d6b1c9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e', 'volume_size': 1} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-302620463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f23a01-38c9-47ed-af98-82985d6b1c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39dc87def7d2461d89142f5d2d0e505c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:18:29Z,use_quota=True,user_id='e052d621ac9f4cc294b954b74b69f361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Creating volume f9f23a01-38c9-47ed-af98-82985d6b1c9e {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:18:29 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:18:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:29 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e 1073741824 Jul 14 21:18:29 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:30 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e 1073741824" returned: 0 in 0.934s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:30 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e Jul 14 21:18:30 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:30 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e" returned: 0 in 0.351s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:18:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e4e853-83ae-465d-9c9f-5cbb14bc646e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50073d7-d200-469d-846a-68af9eed4940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:30 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Volume volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e (f9f23a01-38c9-47ed-af98-82985d6b1c9e): created successfully Jul 14 21:18:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50073d7-d200-469d-846a-68af9eed4940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Flow 'volume_create_manager' (67b51c13-1ff9-4ffc-855d-b0f0a7cfc8ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:18:30 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-9c0c20de-31e2-447a-a2b4-162b6b0be8bb tempest-SnapshotMetadataTestJSON-765275276 None] Created volume successfully. Jul 14 21:18:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] Creating offline snapshot 524fcf45-8d1f-40ae-a481-d629078269e7 of volume f9f23a01-38c9-47ed-af98-82985d6b1c9e {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:18:31 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0bedf4-7413-4430-aae9-8d823f09655d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:18:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:32 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e Jul 14 21:18:32 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:32 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e" returned: 0 in 0.722s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:32 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7 1G Jul 14 21:18:32 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:33 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7 1G" returned: 0 in 0.690s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:33 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7 Jul 14 21:18:33 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:33 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7" returned: 0 in 0.628s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:33 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7 is being set with open permissions: ugo+rw Jul 14 21:18:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:33 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7 Jul 14 21:18:33 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:34 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7" returned: 0 in 0.403s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:34 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.info Jul 14 21:18:34 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:34 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.info" returned: 0 in 0.324s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:34 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.info is being set with open permissions: ugo+rw Jul 14 21:18:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:34 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.info Jul 14 21:18:34 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:34 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.info" returned: 0 in 0.379s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.352s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:35 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-df8da72f-e724-4663-b6d5-67930a580ff1 tempest-SnapshotMetadataTestJSON-765275276 None] Create snapshot completed successfully Jul 14 21:18:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:18:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:18:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:18:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:36 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:18:36 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] Acquiring lock "cinder-524fcf45-8d1f-40ae-a481-d629078269e7-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] Lock "cinder-524fcf45-8d1f-40ae-a481-d629078269e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] Acquiring lock "cinder-quobyte-f9f23a01-38c9-47ed-af98-82985d6b1c9e" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] Lock "cinder-quobyte-f9f23a01-38c9-47ed-af98-82985d6b1c9e" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] Acquiring lock "cinder-quobyte-524fcf45-8d1f-40ae-a481-d629078269e7" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] Lock "cinder-quobyte-524fcf45-8d1f-40ae-a481-d629078269e7" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] Deleting offline snapshot 524fcf45-8d1f-40ae-a481-d629078269e7 of volume f9f23a01-38c9-47ed-af98-82985d6b1c9e {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] snapshot_file for this snap is: volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebeac72-4dd7-45fa-aa5b-4582ea03fc28]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:37 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.696s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 8 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:18:37 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7 Jul 14 21:18:37 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:37 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7" returned: 0 in 0.517s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa3438c-415e-4d77-85bf-c8aaef906566]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:18:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:37 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e Jul 14 21:18:37 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:38 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e" returned: 0 in 0.507s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:38 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7 Jul 14 21:18:38 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:38 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7" returned: 0 in 0.477s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:38 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7 Jul 14 21:18:38 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:39 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e.524fcf45-8d1f-40ae-a481-d629078269e7" returned: 0 in 0.315s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] Lock "cinder-quobyte-524fcf45-8d1f-40ae-a481-d629078269e7" released by "_delete_snapshot" :: held 1.986s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:18:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] Lock "cinder-quobyte-f9f23a01-38c9-47ed-af98-82985d6b1c9e" released by "delete_snapshot" :: held 2.033s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:18:39 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] Created reservations ['506dba91-df28-4486-8304-5f7c190eec8b', 'f6672054-0144-492e-984a-f3539444006c', '058071cb-ba67-4982-bf05-74623a3603b2', 'f6880891-7cdc-457a-9189-ae251804fb0b'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:18:39 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] Delete snapshot completed successfully. Jul 14 21:18:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3bca928f-35c8-4571-b84e-cf0e77cb638d tempest-SnapshotMetadataTestJSON-765275276 None] Lock "cinder-524fcf45-8d1f-40ae-a481-d629078269e7-delete_snapshot" released by "delete_snapshot" :: held 2.350s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:18:39 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-72d6bd82-07a9-4aa6-bfa0-031424e2b365 tempest-GroupsV314Test-1937755887 None] Group tempest-GroupsV314Test-Group-382221746: creating Jul 14 21:18:39 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-72d6bd82-07a9-4aa6-bfa0-031424e2b365 tempest-GroupsV314Test-1937755887 None] Group tempest-GroupsV314Test-Group-382221746: created successfully Jul 14 21:18:39 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-72d6bd82-07a9-4aa6-bfa0-031424e2b365 tempest-GroupsV314Test-1937755887 None] Create group completed successfully. Jul 14 21:18:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] Acquiring lock "cinder-f9f23a01-38c9-47ed-af98-82985d6b1c9e-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] Lock "cinder-f9f23a01-38c9-47ed-af98-82985d6b1c9e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] Acquiring lock "cinder-quobyte-f9f23a01-38c9-47ed-af98-82985d6b1c9e" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] Lock "cinder-quobyte-f9f23a01-38c9-47ed-af98-82985d6b1c9e" acquired by "delete_volume" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:40 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e7d998-8cae-4156-a4a2-6a8dc852d8d5]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:18:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:40 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e Jul 14 21:18:40 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:41 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e" returned: 0 in 0.742s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:41 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e Jul 14 21:18:41 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Flow 'volume_create_manager' (7c2e389a-4718-4172-acce-f3cf56539cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8183d8eb-6c6d-482a-a297-2396b9d841d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8183d8eb-6c6d-482a-a297-2396b9d841d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1657141852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42fdb812-6c19-4837-9f02-6f869ab6b8c0,host='devstack@QuobyteHD#QuobyteHD',id=254c9ba6-8115-481b-b12e-86f31a4fa9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c19770ef3d64812ad10af2b42dcc1c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:18:42Z,use_quota=True,user_id='662cd76c63964992889efa5c675ded1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab393d88-1b91-4308-9f9e-fe0ba16e5098),volume_type_id=ab393d88-1b91-4308-9f9e-fe0ba16e5098)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7030e063-0c6e-4a3c-9dfb-c7655bf627e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7030e063-0c6e-4a3c-9dfb-c7655bf627e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf2d78b-9ebb-4f49-9051-ad9077cf5afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf2d78b-9ebb-4f49-9051-ad9077cf5afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '254c9ba6-8115-481b-b12e-86f31a4fa9c2', 'volume_name': 'volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfe2027-15bd-43ff-9adb-3705f6901e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfe2027-15bd-43ff-9adb-3705f6901e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300faa45-8895-4120-b0c6-d4d9614ab7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:41 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Volume 254c9ba6-8115-481b-b12e-86f31a4fa9c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2', 'volume_size': 1} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=42fdb812-6c19-4837-9f02-6f869ab6b8c0,created_at=2026-07-14T19:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1657141852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42fdb812-6c19-4837-9f02-6f869ab6b8c0,host='devstack@QuobyteHD#QuobyteHD',id=254c9ba6-8115-481b-b12e-86f31a4fa9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c19770ef3d64812ad10af2b42dcc1c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:18:42Z,use_quota=True,user_id='662cd76c63964992889efa5c675ded1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab393d88-1b91-4308-9f9e-fe0ba16e5098),volume_type_id=ab393d88-1b91-4308-9f9e-fe0ba16e5098)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Creating volume 254c9ba6-8115-481b-b12e-86f31a4fa9c2 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:18:41 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:41 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f9f23a01-38c9-47ed-af98-82985d6b1c9e" returned: 0 in 0.531s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:41 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 1073741824 Jul 14 21:18:41 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] Lock "cinder-quobyte-f9f23a01-38c9-47ed-af98-82985d6b1c9e" released by "delete_volume" :: held 1.368s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:18:42 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] Created reservations ['46dec231-92a9-4834-8d2f-43d90f69b375', '21dd2e88-1989-4cc9-a98b-e20e14852f9a', '1d7185ba-be15-43c9-b0f1-08bc00a95ab3', '0391a2a3-c3c3-448b-a997-e49eb376f5e6'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:18:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:42 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:18:42 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:18:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:42 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:18:42 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:42 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.361s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:42 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:18:42 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] Deleted volume successfully. Jul 14 21:18:42 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 1073741824" returned: 0 in 0.781s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db37afaf-3d67-46a4-acd9-40b7020469e5 tempest-SnapshotMetadataTestJSON-765275276 None] Lock "cinder-f9f23a01-38c9-47ed-af98-82985d6b1c9e-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:18:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:42 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 Jul 14 21:18:42 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:42 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2" returned: 0 in 0.317s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:18:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300faa45-8895-4120-b0c6-d4d9614ab7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c83101-f1cf-462a-8348-8ac13cdb2fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:43 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Volume volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 (254c9ba6-8115-481b-b12e-86f31a4fa9c2): created successfully Jul 14 21:18:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c83101-f1cf-462a-8348-8ac13cdb2fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Flow 'volume_create_manager' (7c2e389a-4718-4172-acce-f3cf56539cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:18:43 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-1cfb0ba9-cc9b-4262-a905-5ac1fe005d94 tempest-GroupsV314Test-1937755887 None] Created volume successfully. Jul 14 21:18:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:45 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Cloning volume 254c9ba6-8115-481b-b12e-86f31a4fa9c2 to volume 09a7bfe0-f856-4b4f-be4f-99dbc6c06d94 Jul 14 21:18:45 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Creating offline snapshot 5128e93e-a0f8-4c1c-94b1-0f561388a3f9 of volume 254c9ba6-8115-481b-b12e-86f31a4fa9c2 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:18:45 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d24c8d-677b-4b08-814f-1ca19d2833a4]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:18:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:45 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 Jul 14 21:18:45 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:46 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2" returned: 0 in 0.645s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:46 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9 1G Jul 14 21:18:46 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:46 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9 1G" returned: 0 in 0.584s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:46 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9 Jul 14 21:18:46 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:47 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9" returned: 0 in 0.366s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:47 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 21:18:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:47 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9 Jul 14 21:18:47 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:47 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9" returned: 0 in 0.291s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:47 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.info Jul 14 21:18:47 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:48 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.info" returned: 0 in 0.608s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:48 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 21:18:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:48 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.info Jul 14 21:18:48 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:48 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.info" returned: 0 in 0.447s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:48 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Acquiring lock "cinder-quobyte-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94" by "_copy_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:48 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Lock "cinder-quobyte-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] snapshot: 5128e93e-a0f8-4c1c-94b1-0f561388a3f9, volume: 09a7bfe0-f856-4b4f-be4f-99dbc6c06d94, {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 21:18:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:18:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:18:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:18:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:18:48 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6b04bb-a97c-4b7f-89c9-aedf86f710ec]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:18:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:48 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9 Jul 14 21:18:48 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:49 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9" returned: 0 in 0.818s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:18:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 21:18:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Creating direct copy from snapshot {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 21:18:49 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cf2d3d-d87e-4617-af05-1f0f45330337]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:18:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:49 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 Jul 14 21:18:49 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:50 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2" returned: 0 in 0.531s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:50 devstack cinder-volume[88300]: DEBUG cinder.utils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Path /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94 not found in is_blk_device check {{(pid=88300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 21:18:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:50 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94 Jul 14 21:18:50 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:56 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:18:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Flow 'volume_create_manager' (02e015d9-98ce-4cb9-abf6-1cd3c923b402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:18:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3309838a-44fa-44bc-a034-36ea8cc4d8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3309838a-44fa-44bc-a034-36ea8cc4d8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-809205977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad918db-789b-4ee0-afea-82fa1bb68402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea54385c1e84089beef98d87b1a1a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:18:57Z,use_quota=True,user_id='0aae1a670e7b44b5884d7a37755ffd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0555d8a9-5e88-4058-bba7-feef5d4417be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0555d8a9-5e88-4058-bba7-feef5d4417be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65130ea-8015-47e8-8fd7-278bbdbc16a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65130ea-8015-47e8-8fd7-278bbdbc16a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cad918db-789b-4ee0-afea-82fa1bb68402', 'volume_name': 'volume-cad918db-789b-4ee0-afea-82fa1bb68402', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88689f81-9c04-4570-bbf5-876dd34ee700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88689f81-9c04-4570-bbf5-876dd34ee700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:18:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6982ddb0-ac80-44ae-b404-e6330107f5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:18:57 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Volume cad918db-789b-4ee0-afea-82fa1bb68402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cad918db-789b-4ee0-afea-82fa1bb68402', 'volume_size': 1} Jul 14 21:18:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:18:57 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94" returned: 0 in 7.498s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:57 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df969fd-ed7b-4ffd-b64d-2c98ebefd87f]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:18:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:57 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 Jul 14 21:18:57 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:58 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2" returned: 0 in 0.547s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:58 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Image conversion details: src /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2, size 1024.00 MB, duration 7.50 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94 {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:18:58 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Converted 1024.00 MB image at 136.52 MB/s Jul 14 21:18:58 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 21:18:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:58 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94 Jul 14 21:18:58 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:58 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94" returned: 0 in 0.412s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Lock "cinder-quobyte-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94" released by "_copy_volume_from_snapshot" :: held 9.959s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:18:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Acquiring lock "cinder-quobyte-5128e93e-a0f8-4c1c-94b1-0f561388a3f9" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:18:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Lock "cinder-quobyte-5128e93e-a0f8-4c1c-94b1-0f561388a3f9" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:18:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Deleting offline snapshot 5128e93e-a0f8-4c1c-94b1-0f561388a3f9 of volume 254c9ba6-8115-481b-b12e-86f31a4fa9c2 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:18:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] snapshot_file for this snap is: volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:18:58 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac101ff5-36dc-4731-8f59-707e22f27f80]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:18:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:58 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9 Jul 14 21:18:58 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:59 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9" returned: 0 in 0.468s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:18:59 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1eae85-09d2-4c29-9c15-cdb9cd2e705c]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:18:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:59 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 Jul 14 21:18:59 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:18:59 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Jul 14 21:18:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2" returned: 0 in 0.471s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:18:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:18:59 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9 Jul 14 21:18:59 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:00 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9" returned: 0 in 0.415s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:00 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9 Jul 14 21:19:00 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:00 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2.5128e93e-a0f8-4c1c-94b1-0f561388a3f9" returned: 0 in 0.271s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Lock "cinder-quobyte-5128e93e-a0f8-4c1c-94b1-0f561388a3f9" released by "_delete_snapshot" :: held 1.754s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.044s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.380s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-809205977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad918db-789b-4ee0-afea-82fa1bb68402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea54385c1e84089beef98d87b1a1a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:18:57Z,use_quota=True,user_id='0aae1a670e7b44b5884d7a37755ffd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:19:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Creating volume cad918db-789b-4ee0-afea-82fa1bb68402 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:19:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:19:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:19:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:19:00 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:19:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cad918db-789b-4ee0-afea-82fa1bb68402 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:00 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cad918db-789b-4ee0-afea-82fa1bb68402 1073741824 Jul 14 21:19:00 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:00 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-353fe846-c369-4168-9486-9fe356a7b408 tempest-GroupsV314Test-1937755887 None] Create group from source-group-42fdb812-6c19-4837-9f02-6f869ab6b8c0 completed successfully. Jul 14 21:19:00 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cad918db-789b-4ee0-afea-82fa1bb68402 1073741824" returned: 0 in 0.520s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cad918db-789b-4ee0-afea-82fa1bb68402 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:01 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cad918db-789b-4ee0-afea-82fa1bb68402 Jul 14 21:19:01 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:01 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cad918db-789b-4ee0-afea-82fa1bb68402" returned: 0 in 0.271s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:19:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6982ddb0-ac80-44ae-b404-e6330107f5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cad918db-789b-4ee0-afea-82fa1bb68402', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f371a2-727e-4b5e-8b31-d1b875ba73c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:01 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Volume volume-cad918db-789b-4ee0-afea-82fa1bb68402 (cad918db-789b-4ee0-afea-82fa1bb68402): created successfully Jul 14 21:19:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f371a2-727e-4b5e-8b31-d1b875ba73c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Flow 'volume_create_manager' (02e015d9-98ce-4cb9-abf6-1cd3c923b402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:19:01 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a0661a0d-3bab-4e52-bfcc-fb781681dfe2 tempest-AttachVolumeShelveTestJSON-1595785281 None] Created volume successfully. Jul 14 21:19:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] Acquiring lock "cinder-quobyte-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] Lock "cinder-quobyte-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94" acquired by "delete_volume" :: waited 0.013s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:01 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[06117078-31dc-4bad-9444-a8635233c3e1]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:01 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94 Jul 14 21:19:01 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:02 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94" returned: 0 in 0.406s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:02 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94 Jul 14 21:19:02 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:02 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94" returned: 0 in 0.406s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] Lock "cinder-quobyte-09a7bfe0-f856-4b4f-be4f-99dbc6c06d94" released by "delete_volume" :: held 0.863s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:02 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] Created reservations ['42716e41-07ce-4cf7-b4cc-39930ac855ab'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:19:02 devstack cinder-volume[88300]: WARNING cinder.quota [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1756922090 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1756922090, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:19:02 devstack cinder-volume[88300]: WARNING cinder.quota [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1756922090 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1756922090, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:19:02 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] Created reservations ['817459a1-9bc2-4c74-99cb-5e437fa5b8a0', '2dd454f3-7f88-49db-8648-3e0864d30ece', 'ad6cb144-e6c0-4108-a425-eafc736b9ebe', '4d32f353-c9f1-4f53-9cb4-ef6bc2362464'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:19:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:19:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:19:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:02 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:19:02 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:03 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.408s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:19:03 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-fc8e0f85-5173-4007-a256-f35aa5bbc347 tempest-GroupsV314Test-1937755887 None] Delete group completed successfully. Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] Acquiring lock "cinder-quobyte-254c9ba6-8115-481b-b12e-86f31a4fa9c2" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] Lock "cinder-quobyte-254c9ba6-8115-481b-b12e-86f31a4fa9c2" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfc280d-561f-43cc-938c-48c9d6c2b343]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:03 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 Jul 14 21:19:03 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Flow 'volume_create_manager' (e1c2d23c-5d20-4ca2-b062-bd88992640d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59244331-a439-4b59-ab75-1decbde8d5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59244331-a439-4b59-ab75-1decbde8d5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-579936888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d65fbb-7da5-409e-a454-646c750b2b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef22bf581b446d8ba6182c0908749b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:19:04Z,use_quota=True,user_id='5350f08f496342618b18ad5e05a9433c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28229513-0a21-4417-884c-6d23af688bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28229513-0a21-4417-884c-6d23af688bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1590a7f-e0c4-40da-ab89-76c2f757dc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1590a7f-e0c4-40da-ab89-76c2f757dc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8d65fbb-7da5-409e-a454-646c750b2b3c', 'volume_name': 'volume-f8d65fbb-7da5-409e-a454-646c750b2b3c', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98343c62-f327-4a3a-b17f-d6237b8d508b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98343c62-f327-4a3a-b17f-d6237b8d508b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e30de4-c926-434c-b3a1-23540833de51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:03 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Volume f8d65fbb-7da5-409e-a454-646c750b2b3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8d65fbb-7da5-409e-a454-646c750b2b3c', 'volume_size': 1} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-579936888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d65fbb-7da5-409e-a454-646c750b2b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef22bf581b446d8ba6182c0908749b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:19:04Z,use_quota=True,user_id='5350f08f496342618b18ad5e05a9433c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Creating volume f8d65fbb-7da5-409e-a454-646c750b2b3c {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:19:03 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:03 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c 1073741824 Jul 14 21:19:03 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:03 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2" returned: 0 in 0.501s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:03 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2 Jul 14 21:19:03 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:04 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-254c9ba6-8115-481b-b12e-86f31a4fa9c2" returned: 0 in 0.367s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] Lock "cinder-quobyte-254c9ba6-8115-481b-b12e-86f31a4fa9c2" released by "delete_volume" :: held 1.007s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:04 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c 1073741824" returned: 0 in 0.582s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] Created reservations ['d9bda858-f908-4cbc-9bdd-45cf74f787a9'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:04 devstack sudo[94855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c Jul 14 21:19:04 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] Created reservations ['9806a7df-4c88-4944-b59c-e4de899786d8', '7bf158d6-f039-420d-a779-9df584f75280', '220488db-995f-4d09-af0f-2dc652be4325', 'b7ecae57-6541-42c7-b9a4-684b13c0c7a7'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:04 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:19:04 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:04 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c" returned: 0 in 0.292s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e30de4-c926-434c-b3a1-23540833de51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d65fbb-7da5-409e-a454-646c750b2b3c', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52aeb7d7-e036-4b17-b6d0-ffe3095d394e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:04 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Volume volume-f8d65fbb-7da5-409e-a454-646c750b2b3c (f8d65fbb-7da5-409e-a454-646c750b2b3c): created successfully Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52aeb7d7-e036-4b17-b6d0-ffe3095d394e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Flow 'volume_create_manager' (e1c2d23c-5d20-4ca2-b062-bd88992640d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:19:04 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-ca68471e-8ac1-4634-a5e4-12f786d5715a tempest-VolumesActionsTest-346411820 None] Created volume successfully. Jul 14 21:19:04 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.313s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:04 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:19:04 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0f81c1c3-6a92-483a-8aea-1fc6b3a82259 tempest-GroupsV314Test-1937755887 None] Delete group completed successfully. Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Flow 'volume_create_manager' (0d214bd6-0ec6-46ab-afdd-ab7c1dc8acf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec94f6d9-e0d7-468c-9983-9690a1887c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec94f6d9-e0d7-468c-9983-9690a1887c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-227852995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d925e6a-eacc-4067-8200-2fe5669d313f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7472be6d648d490dba2726a631060c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:19:11Z,use_quota=True,user_id='5c95963ce2ee41749f8f1ce2a486c314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a29dc7-d789-4664-ba9e-c8795803b3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a29dc7-d789-4664-ba9e-c8795803b3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a3aa49-c45a-4ed0-89dc-06ec2b3db168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a3aa49-c45a-4ed0-89dc-06ec2b3db168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d925e6a-eacc-4067-8200-2fe5669d313f', 'volume_name': 'volume-7d925e6a-eacc-4067-8200-2fe5669d313f', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f83a610-3ffb-4f75-ac3f-3003f0badf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f83a610-3ffb-4f75-ac3f-3003f0badf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eac4d37-ae7e-4478-bc36-f07a67603c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:10 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Volume 7d925e6a-eacc-4067-8200-2fe5669d313f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d925e6a-eacc-4067-8200-2fe5669d313f', 'volume_size': 1} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-227852995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d925e6a-eacc-4067-8200-2fe5669d313f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7472be6d648d490dba2726a631060c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:19:11Z,use_quota=True,user_id='5c95963ce2ee41749f8f1ce2a486c314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Creating volume 7d925e6a-eacc-4067-8200-2fe5669d313f {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:19:10 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:19:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7d925e6a-eacc-4067-8200-2fe5669d313f 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:10 devstack sudo[94900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7d925e6a-eacc-4067-8200-2fe5669d313f 1073741824 Jul 14 21:19:10 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:11 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7d925e6a-eacc-4067-8200-2fe5669d313f 1073741824" returned: 0 in 0.549s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7d925e6a-eacc-4067-8200-2fe5669d313f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:11 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7d925e6a-eacc-4067-8200-2fe5669d313f Jul 14 21:19:11 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:11 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7d925e6a-eacc-4067-8200-2fe5669d313f" returned: 0 in 0.364s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:19:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eac4d37-ae7e-4478-bc36-f07a67603c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d925e6a-eacc-4067-8200-2fe5669d313f', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36e7135-1abb-4c23-b8c6-861c9dc16d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:11 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Volume volume-7d925e6a-eacc-4067-8200-2fe5669d313f (7d925e6a-eacc-4067-8200-2fe5669d313f): created successfully Jul 14 21:19:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36e7135-1abb-4c23-b8c6-861c9dc16d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Flow 'volume_create_manager' (0d214bd6-0ec6-46ab-afdd-ab7c1dc8acf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:19:11 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-3bb87e13-c0ec-47a6-8708-58f5b17e7fca tempest-AttachVolumeTestJSON-1079889311 None] Created volume successfully. Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Flow 'volume_create_manager' (c91bfed8-56d6-4ebc-ba64-bd57e9cc30e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660281f7-04c3-46e1-8786-731abc88b781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660281f7-04c3-46e1-8786-731abc88b781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1342810868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ade2a1-478c-4211-bdae-6306ca6b948d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eecccf723184663b404369d2b6af555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:19:12Z,use_quota=True,user_id='3d9175cb81614aafab23ffd5abe5828b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2229a37e-2889-4720-87af-d59a7a68e2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2229a37e-2889-4720-87af-d59a7a68e2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b83a5dd-750c-4185-b2b4-b07c2a608e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b83a5dd-750c-4185-b2b4-b07c2a608e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44ade2a1-478c-4211-bdae-6306ca6b948d', 'volume_name': 'volume-44ade2a1-478c-4211-bdae-6306ca6b948d', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3bca88c-5e5c-46fb-9a7b-a17bf92a6ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3bca88c-5e5c-46fb-9a7b-a17bf92a6ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02dcdd5-8d78-4fce-b40c-e1ce9e856dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:12 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Volume 44ade2a1-478c-4211-bdae-6306ca6b948d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44ade2a1-478c-4211-bdae-6306ca6b948d', 'volume_size': 1} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1342810868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ade2a1-478c-4211-bdae-6306ca6b948d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eecccf723184663b404369d2b6af555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:19:12Z,use_quota=True,user_id='3d9175cb81614aafab23ffd5abe5828b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Creating volume 44ade2a1-478c-4211-bdae-6306ca6b948d {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:19:12 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:12 devstack sudo[94929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d 1073741824 Jul 14 21:19:12 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:12 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d 1073741824" returned: 0 in 0.635s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:13 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d Jul 14 21:19:13 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:13 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d" returned: 0 in 0.556s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:13 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:19:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:13 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02dcdd5-8d78-4fce-b40c-e1ce9e856dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ade2a1-478c-4211-bdae-6306ca6b948d', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:13 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71964b53-92bd-416f-a502-9e2b057ba350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:13 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Volume volume-44ade2a1-478c-4211-bdae-6306ca6b948d (44ade2a1-478c-4211-bdae-6306ca6b948d): created successfully Jul 14 21:19:13 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71964b53-92bd-416f-a502-9e2b057ba350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:13 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Flow 'volume_create_manager' (c91bfed8-56d6-4ebc-ba64-bd57e9cc30e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:19:13 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-da2cadf8-a606-4f5e-9d4b-8f6a8acdd720 tempest-SnapshotsActionsTest-1281282332 None] Created volume successfully. Jul 14 21:19:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-a462d4b3-55c9-4d9e-8661-b9b10f036fbc req-0a8bca7e-b375-4203-8caa-d749b2f6df8e tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-a462d4b3-55c9-4d9e-8661-b9b10f036fbc req-0a8bca7e-b375-4203-8caa-d749b2f6df8e tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:14 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9b1995-4519-4351-ab6e-f3e5da1c8a9f]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-a462d4b3-55c9-4d9e-8661-b9b10f036fbc req-0a8bca7e-b375-4203-8caa-d749b2f6df8e tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7d925e6a-eacc-4067-8200-2fe5669d313f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:14 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7d925e6a-eacc-4067-8200-2fe5669d313f Jul 14 21:19:14 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:14 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-a462d4b3-55c9-4d9e-8661-b9b10f036fbc req-0a8bca7e-b375-4203-8caa-d749b2f6df8e tempest-AttachVolumeTestJSON-1079889311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7d925e6a-eacc-4067-8200-2fe5669d313f" returned: 0 in 0.647s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-a462d4b3-55c9-4d9e-8661-b9b10f036fbc req-0a8bca7e-b375-4203-8caa-d749b2f6df8e tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.688s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.058s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] Creating offline snapshot eeef90f3-249a-40c7-b74a-039623c164d4 of volume 44ade2a1-478c-4211-bdae-6306ca6b948d {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:19:14 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[132c8f7b-1205-4cce-bc97-30482953496b]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-a462d4b3-55c9-4d9e-8661-b9b10f036fbc req-0a8bca7e-b375-4203-8caa-d749b2f6df8e tempest-AttachVolumeTestJSON-1079889311 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-7d925e6a-eacc-4067-8200-2fe5669d313f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '467c5ebe-8eb9-4504-8643-3c2e12d05467', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:19:14 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-a462d4b3-55c9-4d9e-8661-b9b10f036fbc req-0a8bca7e-b375-4203-8caa-d749b2f6df8e tempest-AttachVolumeTestJSON-1079889311 None] attachment_update completed successfully. Jul 14 21:19:14 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d Jul 14 21:19:14 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:15 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d" returned: 0 in 0.460s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:15 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 1G Jul 14 21:19:15 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-fcb6fb0c-0ada-420f-88d7-33b66bafe880 req-69c0f933-38d1-4b35-b834-1cca9e52466a tempest-AttachVolumeShelveTestJSON-1595785281 None] No connector for attachment 147fbda1-b0c9-446e-8905-d0471c3480bd; skipping storage backend terminate_connection call. {{(pid=88300) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 14 21:19:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-fcb6fb0c-0ada-420f-88d7-33b66bafe880 req-69c0f933-38d1-4b35-b834-1cca9e52466a tempest-AttachVolumeShelveTestJSON-1595785281 None] Deleting attachment 147fbda1-b0c9-446e-8905-d0471c3480bd. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:19:15 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 1G" returned: 0 in 0.543s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ade2a1-478c-4211-bdae-6306ca6b948d -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:15 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ade2a1-478c-4211-bdae-6306ca6b948d -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 Jul 14 21:19:15 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:16 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ade2a1-478c-4211-bdae-6306ca6b948d -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4" returned: 0 in 0.303s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:16 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 is being set with open permissions: ugo+rw Jul 14 21:19:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:16 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 Jul 14 21:19:16 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:16 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4" returned: 0 in 0.454s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:16 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.info Jul 14 21:19:16 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:16 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.info" returned: 0 in 0.363s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:16 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.info is being set with open permissions: ugo+rw Jul 14 21:19:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:16 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.info Jul 14 21:19:16 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7322eef5-9244-4ae0-a0ae-86b970375904 tempest-VolumesActionsTest-346411820 None] Acquiring lock "cinder-f8d65fbb-7da5-409e-a454-646c750b2b3c" by "attach_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7322eef5-9244-4ae0-a0ae-86b970375904 tempest-VolumesActionsTest-346411820 None] Lock "cinder-f8d65fbb-7da5-409e-a454-646c750b2b3c" acquired by "attach_volume" :: waited 0.026s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:17 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-7322eef5-9244-4ae0-a0ae-86b970375904 tempest-VolumesActionsTest-346411820 None] Attaching volume f8d65fbb-7da5-409e-a454-646c750b2b3c to instance 58a95569-acdf-4049-83e9-52fb17233688 at mountpoint /dev/vdb on host None. Jul 14 21:19:17 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-7322eef5-9244-4ae0-a0ae-86b970375904 tempest-VolumesActionsTest-346411820 None] Attach volume completed successfully. Jul 14 21:19:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7322eef5-9244-4ae0-a0ae-86b970375904 tempest-VolumesActionsTest-346411820 None] Lock "cinder-f8d65fbb-7da5-409e-a454-646c750b2b3c" released by "attach_volume" :: held 0.200s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:17 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.info" returned: 0 in 0.415s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:17 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a0dcf860-108a-472a-9143-10dd9f8c0422 tempest-SnapshotsActionsTest-1281282332 None] Create snapshot completed successfully Jul 14 21:19:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fdbdeadf-b3f5-4452-b76a-38dcfbb11ea7 tempest-VolumesActionsTest-346411820 None] Acquiring lock "cinder-f8d65fbb-7da5-409e-a454-646c750b2b3c-detach_volume" by "detach_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fdbdeadf-b3f5-4452-b76a-38dcfbb11ea7 tempest-VolumesActionsTest-346411820 None] Lock "cinder-f8d65fbb-7da5-409e-a454-646c750b2b3c-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:17 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-fdbdeadf-b3f5-4452-b76a-38dcfbb11ea7 tempest-VolumesActionsTest-346411820 None] Detaching volume f8d65fbb-7da5-409e-a454-646c750b2b3c from instance 58a95569-acdf-4049-83e9-52fb17233688. Jul 14 21:19:17 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-fdbdeadf-b3f5-4452-b76a-38dcfbb11ea7 tempest-VolumesActionsTest-346411820 None] Detach volume completed successfully. Jul 14 21:19:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fdbdeadf-b3f5-4452-b76a-38dcfbb11ea7 tempest-VolumesActionsTest-346411820 None] Lock "cinder-f8d65fbb-7da5-409e-a454-646c750b2b3c-detach_volume" released by "detach_volume" :: held 0.108s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Flow 'volume_create_manager' (23079033-50e4-46a9-9b12-cd270ea65d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d502353c-1b74-4cf7-9625-f25538d4c8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d502353c-1b74-4cf7-9625-f25538d4c8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1443400956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3317d59d-0031-4160-a11a-bf7cf27e66b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7472be6d648d490dba2726a631060c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:19:18Z,use_quota=True,user_id='5c95963ce2ee41749f8f1ce2a486c314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1895b556-348a-4008-9e4d-faeede75f6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1895b556-348a-4008-9e4d-faeede75f6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787b8dca-b180-47b7-bbe7-48991c3a3368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787b8dca-b180-47b7-bbe7-48991c3a3368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3317d59d-0031-4160-a11a-bf7cf27e66b0', 'volume_name': 'volume-3317d59d-0031-4160-a11a-bf7cf27e66b0', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46424e78-cb76-4454-b7cb-dae1dc751d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46424e78-cb76-4454-b7cb-dae1dc751d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ff8354-eafd-463d-b1e1-17e07b0e5eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:18 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Volume 3317d59d-0031-4160-a11a-bf7cf27e66b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3317d59d-0031-4160-a11a-bf7cf27e66b0', 'volume_size': 1} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1443400956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3317d59d-0031-4160-a11a-bf7cf27e66b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7472be6d648d490dba2726a631060c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:19:18Z,use_quota=True,user_id='5c95963ce2ee41749f8f1ce2a486c314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Creating volume 3317d59d-0031-4160-a11a-bf7cf27e66b0 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:19:18 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:19:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3317d59d-0031-4160-a11a-bf7cf27e66b0 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:18 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3317d59d-0031-4160-a11a-bf7cf27e66b0 1073741824 Jul 14 21:19:18 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-33c8a449-941b-4fdd-b9ff-864d3069d69a tempest-SnapshotsActionsTest-1281282332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:19 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3317d59d-0031-4160-a11a-bf7cf27e66b0 1073741824" returned: 0 in 0.963s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3317d59d-0031-4160-a11a-bf7cf27e66b0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:19 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3317d59d-0031-4160-a11a-bf7cf27e66b0 Jul 14 21:19:19 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:19 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3317d59d-0031-4160-a11a-bf7cf27e66b0" returned: 0 in 0.354s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:19:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-33c8a449-941b-4fdd-b9ff-864d3069d69a tempest-SnapshotsActionsTest-1281282332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.564s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ff8354-eafd-463d-b1e1-17e07b0e5eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3317d59d-0031-4160-a11a-bf7cf27e66b0', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947289bb-2834-4edd-9065-0006d4020493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:19:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-33c8a449-941b-4fdd-b9ff-864d3069d69a tempest-SnapshotsActionsTest-1281282332 None] Creating offline snapshot ea787532-2b28-4119-b252-f822c8333088 of volume 44ade2a1-478c-4211-bdae-6306ca6b948d {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:19:19 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Volume volume-3317d59d-0031-4160-a11a-bf7cf27e66b0 (3317d59d-0031-4160-a11a-bf7cf27e66b0): created successfully Jul 14 21:19:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947289bb-2834-4edd-9065-0006d4020493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:19:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Flow 'volume_create_manager' (23079033-50e4-46a9-9b12-cd270ea65d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:19:19 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4954465-5e6e-4bbe-8760-d39c3f320de0]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-33c8a449-941b-4fdd-b9ff-864d3069d69a tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:19 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d24ea892-dddf-4fb9-99a0-fcfe84ea087b tempest-AttachVolumeTestJSON-1079889311 None] Created volume successfully. Jul 14 21:19:20 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 Jul 14 21:19:20 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:20 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-33c8a449-941b-4fdd-b9ff-864d3069d69a tempest-SnapshotsActionsTest-1281282332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4" returned: 0 in 0.493s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-33c8a449-941b-4fdd-b9ff-864d3069d69a tempest-SnapshotsActionsTest-1281282332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44ade2a1-478c-4211-bdae-6306ca6b948d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:19:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-33c8a449-941b-4fdd-b9ff-864d3069d69a tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:20 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088 1G Jul 14 21:19:20 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:21 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-33c8a449-941b-4fdd-b9ff-864d3069d69a tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088 1G" returned: 0 in 0.693s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-33c8a449-941b-4fdd-b9ff-864d3069d69a tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:21 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088 Jul 14 21:19:21 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-6d7e3d07-da6f-46c9-9b4c-c3f54f298a4c req-c9f41633-9deb-494a-a4a5-14cee05d08f6 tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:21 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-33c8a449-941b-4fdd-b9ff-864d3069d69a tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088" returned: 0 in 0.430s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:21 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-33c8a449-941b-4fdd-b9ff-864d3069d69a tempest-SnapshotsActionsTest-1281282332 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088 is being set with open permissions: ugo+rw Jul 14 21:19:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-33c8a449-941b-4fdd-b9ff-864d3069d69a tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:21 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088 Jul 14 21:19:21 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:21 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-33c8a449-941b-4fdd-b9ff-864d3069d69a tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088" returned: 0 in 0.268s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-33c8a449-941b-4fdd-b9ff-864d3069d69a tempest-SnapshotsActionsTest-1281282332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.068s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-6d7e3d07-da6f-46c9-9b4c-c3f54f298a4c req-c9f41633-9deb-494a-a4a5-14cee05d08f6 tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.585s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:21 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8805530-8f67-49ef-9560-77bcfa24a1a0]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-6d7e3d07-da6f-46c9-9b4c-c3f54f298a4c req-c9f41633-9deb-494a-a4a5-14cee05d08f6 tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3317d59d-0031-4160-a11a-bf7cf27e66b0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:21 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-33c8a449-941b-4fdd-b9ff-864d3069d69a tempest-SnapshotsActionsTest-1281282332 None] Create snapshot completed successfully Jul 14 21:19:21 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3317d59d-0031-4160-a11a-bf7cf27e66b0 Jul 14 21:19:21 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:22 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-6d7e3d07-da6f-46c9-9b4c-c3f54f298a4c req-c9f41633-9deb-494a-a4a5-14cee05d08f6 tempest-AttachVolumeTestJSON-1079889311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3317d59d-0031-4160-a11a-bf7cf27e66b0" returned: 0 in 0.465s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-6d7e3d07-da6f-46c9-9b4c-c3f54f298a4c req-c9f41633-9deb-494a-a4a5-14cee05d08f6 tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.500s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-6d7e3d07-da6f-46c9-9b4c-c3f54f298a4c req-c9f41633-9deb-494a-a4a5-14cee05d08f6 tempest-AttachVolumeTestJSON-1079889311 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-3317d59d-0031-4160-a11a-bf7cf27e66b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0356759-5992-4da6-98b5-349fff90512a', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:19:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Acquiring lock "cinder-ea787532-2b28-4119-b252-f822c8333088-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-ea787532-2b28-4119-b252-f822c8333088-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Acquiring lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Acquiring lock "cinder-quobyte-ea787532-2b28-4119-b252-f822c8333088" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:22 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-6d7e3d07-da6f-46c9-9b4c-c3f54f298a4c req-c9f41633-9deb-494a-a4a5-14cee05d08f6 tempest-AttachVolumeTestJSON-1079889311 None] attachment_update completed successfully. Jul 14 21:19:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-quobyte-ea787532-2b28-4119-b252-f822c8333088" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Deleting offline snapshot ea787532-2b28-4119-b252-f822c8333088 of volume 44ade2a1-478c-4211-bdae-6306ca6b948d {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:19:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] snapshot_file for this snap is: volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:19:22 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[22606d59-0d0f-4688-8a5e-5c08fb54af16]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:22 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088 Jul 14 21:19:22 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:23 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088" returned: 0 in 0.463s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44ade2a1-478c-4211-bdae-6306ca6b948d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:19:23 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[38890b7e-68ec-4ed6-aa19-e3e0b398a7a1]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:23 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 Jul 14 21:19:23 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:23 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4" returned: 0 in 0.504s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44ade2a1-478c-4211-bdae-6306ca6b948d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:19:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:23 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088 Jul 14 21:19:23 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:24 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088" returned: 0 in 0.598s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:24 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088 Jul 14 21:19:24 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:24 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.ea787532-2b28-4119-b252-f822c8333088" returned: 0 in 0.370s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-quobyte-ea787532-2b28-4119-b252-f822c8333088" released by "_delete_snapshot" :: held 2.119s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" released by "delete_snapshot" :: held 2.161s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:24 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Created reservations ['f3de9c7e-f919-49f3-be60-4a100c7d0635', 'cd62fded-6ce0-417b-b5c1-da426c3c430f', '77a4a05f-59be-4131-b0d6-d5390410b08e', '2a3d3cd6-3b8d-4d37-8c15-27c60ce68a2e'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:19:24 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Delete snapshot completed successfully. Jul 14 21:19:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a515c824-26fb-45c8-bc46-18f3c383bd38 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-ea787532-2b28-4119-b252-f822c8333088-delete_snapshot" released by "delete_snapshot" :: held 2.376s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:25 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-b9eea1f6-79eb-4278-9172-acf9f48a3ab0 req-559fc442-ed67-44bf-b8b8-449c4785cbd4 tempest-AttachVolumeTestJSON-1079889311 None] Terminate volume connection completed successfully. Jul 14 21:19:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-b9eea1f6-79eb-4278-9172-acf9f48a3ab0 req-559fc442-ed67-44bf-b8b8-449c4785cbd4 tempest-AttachVolumeTestJSON-1079889311 None] Deleting attachment 467c5ebe-8eb9-4504-8643-3c2e12d05467. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:19:26 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:UPDATE=77,cinder:SELECT=84,cinder:INSERT=19,cinder:DELETE=6 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:19:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-bcade440-f457-4a89-ba60-cb483f2b2fb6 tempest-SnapshotsActionsTest-1281282332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-bcade440-f457-4a89-ba60-cb483f2b2fb6 tempest-SnapshotsActionsTest-1281282332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:26 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-bcade440-f457-4a89-ba60-cb483f2b2fb6 tempest-SnapshotsActionsTest-1281282332 None] Creating offline snapshot 3e714487-a790-4695-9598-f897a6628b24 of volume 44ade2a1-478c-4211-bdae-6306ca6b948d {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:19:26 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[028961eb-1681-4c44-ae27-53d90f9902dd]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bcade440-f457-4a89-ba60-cb483f2b2fb6 tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:26 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 Jul 14 21:19:26 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:26 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bcade440-f457-4a89-ba60-cb483f2b2fb6 tempest-SnapshotsActionsTest-1281282332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4" returned: 0 in 0.563s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:26 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-bcade440-f457-4a89-ba60-cb483f2b2fb6 tempest-SnapshotsActionsTest-1281282332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44ade2a1-478c-4211-bdae-6306ca6b948d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:19:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bcade440-f457-4a89-ba60-cb483f2b2fb6 tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:26 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24 1G Jul 14 21:19:26 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:27 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=85,cinder:UPDATE=76,cinder:DELETE=5,cinder:INSERT=16 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:19:27 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-225cce6a-cc85-4a1e-b9ea-0bd5cd189cb0 req-9c3f63f1-42bf-40ff-a717-fc302ce05748 tempest-AttachVolumeTestJSON-1079889311 None] Terminate volume connection completed successfully. Jul 14 21:19:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-225cce6a-cc85-4a1e-b9ea-0bd5cd189cb0 req-9c3f63f1-42bf-40ff-a717-fc302ce05748 tempest-AttachVolumeTestJSON-1079889311 None] Deleting attachment f0356759-5992-4da6-98b5-349fff90512a. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:19:27 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bcade440-f457-4a89-ba60-cb483f2b2fb6 tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24 1G" returned: 0 in 0.771s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bcade440-f457-4a89-ba60-cb483f2b2fb6 tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:27 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24 Jul 14 21:19:27 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:28 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bcade440-f457-4a89-ba60-cb483f2b2fb6 tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24" returned: 0 in 0.362s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:28 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-bcade440-f457-4a89-ba60-cb483f2b2fb6 tempest-SnapshotsActionsTest-1281282332 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24 is being set with open permissions: ugo+rw Jul 14 21:19:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bcade440-f457-4a89-ba60-cb483f2b2fb6 tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:28 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24 Jul 14 21:19:28 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:28 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bcade440-f457-4a89-ba60-cb483f2b2fb6 tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24" returned: 0 in 0.513s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-bcade440-f457-4a89-ba60-cb483f2b2fb6 tempest-SnapshotsActionsTest-1281282332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.443s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:28 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-bcade440-f457-4a89-ba60-cb483f2b2fb6 tempest-SnapshotsActionsTest-1281282332 None] Create snapshot completed successfully Jul 14 21:19:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Acquiring lock "cinder-3e714487-a790-4695-9598-f897a6628b24-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-3e714487-a790-4695-9598-f897a6628b24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Acquiring lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Acquiring lock "cinder-quobyte-3e714487-a790-4695-9598-f897a6628b24" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-quobyte-3e714487-a790-4695-9598-f897a6628b24" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Deleting offline snapshot 3e714487-a790-4695-9598-f897a6628b24 of volume 44ade2a1-478c-4211-bdae-6306ca6b948d {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:19:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] snapshot_file for this snap is: volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:19:30 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a932c82-fff0-4851-9737-74942d6e5ca3]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:30 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24 Jul 14 21:19:30 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:31 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24" returned: 0 in 1.154s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44ade2a1-478c-4211-bdae-6306ca6b948d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:19:31 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01e0683-905d-46af-8a3a-fef8a3a59a51]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:31 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 Jul 14 21:19:31 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:32 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4" returned: 0 in 1.027s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44ade2a1-478c-4211-bdae-6306ca6b948d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:19:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:32 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24 Jul 14 21:19:32 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:33 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24" returned: 0 in 0.955s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:33 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24 Jul 14 21:19:33 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0b44c097-e2ba-4f34-b6d4-a21bc5b32e28 tempest-VolumesActionsTest-346411820 None] Acquiring lock "cinder-f8d65fbb-7da5-409e-a454-646c750b2b3c" by "attach_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0b44c097-e2ba-4f34-b6d4-a21bc5b32e28 tempest-VolumesActionsTest-346411820 None] Lock "cinder-f8d65fbb-7da5-409e-a454-646c750b2b3c" acquired by "attach_volume" :: waited 0.030s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:34 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0b44c097-e2ba-4f34-b6d4-a21bc5b32e28 tempest-VolumesActionsTest-346411820 None] Attaching volume f8d65fbb-7da5-409e-a454-646c750b2b3c to instance e82cea97-9546-4686-a1ea-9d0eba915668 at mountpoint /dev/vdb on host None. Jul 14 21:19:34 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0b44c097-e2ba-4f34-b6d4-a21bc5b32e28 tempest-VolumesActionsTest-346411820 None] Attach volume completed successfully. Jul 14 21:19:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0b44c097-e2ba-4f34-b6d4-a21bc5b32e28 tempest-VolumesActionsTest-346411820 None] Lock "cinder-f8d65fbb-7da5-409e-a454-646c750b2b3c" released by "attach_volume" :: held 0.137s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:34 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.3e714487-a790-4695-9598-f897a6628b24" returned: 0 in 0.779s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-quobyte-3e714487-a790-4695-9598-f897a6628b24" released by "_delete_snapshot" :: held 4.267s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" released by "delete_snapshot" :: held 4.337s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b349154f-2d22-4271-a137-e3a5257ae0c7 tempest-VolumesActionsTest-346411820 None] Acquiring lock "cinder-f8d65fbb-7da5-409e-a454-646c750b2b3c-detach_volume" by "detach_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b349154f-2d22-4271-a137-e3a5257ae0c7 tempest-VolumesActionsTest-346411820 None] Lock "cinder-f8d65fbb-7da5-409e-a454-646c750b2b3c-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:34 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-b349154f-2d22-4271-a137-e3a5257ae0c7 tempest-VolumesActionsTest-346411820 None] Detaching volume f8d65fbb-7da5-409e-a454-646c750b2b3c from instance e82cea97-9546-4686-a1ea-9d0eba915668. Jul 14 21:19:34 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Created reservations ['a80ca87d-77d1-4e9c-a6ff-0b7e2478c7dc', '7f79d19a-ca65-4ebb-9ebb-4f0a5ed543e1', 'd109695c-940a-4f49-935c-1e55e9a90496', 'e9e95eb1-b46c-4b6b-9696-e4e5001c6737'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:19:34 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-b349154f-2d22-4271-a137-e3a5257ae0c7 tempest-VolumesActionsTest-346411820 None] Detach volume completed successfully. Jul 14 21:19:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b349154f-2d22-4271-a137-e3a5257ae0c7 tempest-VolumesActionsTest-346411820 None] Lock "cinder-f8d65fbb-7da5-409e-a454-646c750b2b3c-detach_volume" released by "detach_volume" :: held 0.142s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:34 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Delete snapshot completed successfully. Jul 14 21:19:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7fc81322-36e4-40e7-8bf3-c82b2f80537a tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-3e714487-a790-4695-9598-f897a6628b24-delete_snapshot" released by "delete_snapshot" :: held 4.852s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6309ff54-bfef-42ed-9c08-a46110236468 tempest-SnapshotsActionsTest-1281282332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6309ff54-bfef-42ed-9c08-a46110236468 tempest-SnapshotsActionsTest-1281282332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-6309ff54-bfef-42ed-9c08-a46110236468 tempest-SnapshotsActionsTest-1281282332 None] Creating offline snapshot 0de111d1-d977-4f64-ad34-633cc283f963 of volume 44ade2a1-478c-4211-bdae-6306ca6b948d {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:19:36 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f429ffba-1aaf-4f6b-bc7a-df0a73adfa66]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6309ff54-bfef-42ed-9c08-a46110236468 tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:36 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 Jul 14 21:19:36 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:19:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:19:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:19:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:36 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:19:36 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:36 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6309ff54-bfef-42ed-9c08-a46110236468 tempest-SnapshotsActionsTest-1281282332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4" returned: 0 in 0.482s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-6309ff54-bfef-42ed-9c08-a46110236468 tempest-SnapshotsActionsTest-1281282332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44ade2a1-478c-4211-bdae-6306ca6b948d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:19:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6309ff54-bfef-42ed-9c08-a46110236468 tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:36 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963 1G Jul 14 21:19:36 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:37 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.742s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:37 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:19:37 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:19:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 8 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:19:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:19:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "cinder-3317d59d-0031-4160-a11a-bf7cf27e66b0-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] Lock "cinder-3317d59d-0031-4160-a11a-bf7cf27e66b0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "cinder-quobyte-3317d59d-0031-4160-a11a-bf7cf27e66b0" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] Lock "cinder-quobyte-3317d59d-0031-4160-a11a-bf7cf27e66b0" acquired by "delete_volume" :: waited 0.030s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:37 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f043e16b-c13d-4fc0-9af2-f09e16039fa5]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3317d59d-0031-4160-a11a-bf7cf27e66b0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:37 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3317d59d-0031-4160-a11a-bf7cf27e66b0 Jul 14 21:19:37 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:37 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6309ff54-bfef-42ed-9c08-a46110236468 tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963 1G" returned: 0 in 0.845s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6309ff54-bfef-42ed-9c08-a46110236468 tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:37 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963 Jul 14 21:19:37 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:37 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3317d59d-0031-4160-a11a-bf7cf27e66b0" returned: 0 in 0.453s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3317d59d-0031-4160-a11a-bf7cf27e66b0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:37 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3317d59d-0031-4160-a11a-bf7cf27e66b0 Jul 14 21:19:37 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:38 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6309ff54-bfef-42ed-9c08-a46110236468 tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963" returned: 0 in 0.341s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:38 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-6309ff54-bfef-42ed-9c08-a46110236468 tempest-SnapshotsActionsTest-1281282332 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963 is being set with open permissions: ugo+rw Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6309ff54-bfef-42ed-9c08-a46110236468 tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:38 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963 Jul 14 21:19:38 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:38 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3317d59d-0031-4160-a11a-bf7cf27e66b0" returned: 0 in 0.253s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] Lock "cinder-quobyte-3317d59d-0031-4160-a11a-bf7cf27e66b0" released by "delete_volume" :: held 0.765s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:38 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6309ff54-bfef-42ed-9c08-a46110236468 tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963" returned: 0 in 0.267s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6309ff54-bfef-42ed-9c08-a46110236468 tempest-SnapshotsActionsTest-1281282332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] Created reservations ['3024656b-3312-4fd6-8c7d-0a942ba6a260', 'b0796262-7e52-4218-9708-b741e9ec813f', '6a6e2e66-a2cd-4755-b7e4-21e05521e391', 'e252ca59-a20d-476c-8845-bc2c1673d610'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:19:38 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-6309ff54-bfef-42ed-9c08-a46110236468 tempest-SnapshotsActionsTest-1281282332 None] Create snapshot completed successfully Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:38 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:19:38 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "cinder-7d925e6a-eacc-4067-8200-2fe5669d313f-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] Lock "cinder-7d925e6a-eacc-4067-8200-2fe5669d313f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "cinder-quobyte-7d925e6a-eacc-4067-8200-2fe5669d313f" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] Lock "cinder-quobyte-7d925e6a-eacc-4067-8200-2fe5669d313f" acquired by "delete_volume" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[16be8a45-3519-46be-984d-688dc3a09a44]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7d925e6a-eacc-4067-8200-2fe5669d313f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:38 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.437s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:19:38 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] Deleted volume successfully. Jul 14 21:19:38 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7d925e6a-eacc-4067-8200-2fe5669d313f Jul 14 21:19:38 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:38 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a83c3f5d-c599-46d6-bc48-6b338fa6ff67 tempest-AttachVolumeTestJSON-1079889311 None] Lock "cinder-3317d59d-0031-4160-a11a-bf7cf27e66b0-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:39 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7d925e6a-eacc-4067-8200-2fe5669d313f" returned: 0 in 0.466s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7d925e6a-eacc-4067-8200-2fe5669d313f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:39 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7d925e6a-eacc-4067-8200-2fe5669d313f Jul 14 21:19:39 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:39 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7d925e6a-eacc-4067-8200-2fe5669d313f" returned: 0 in 0.299s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] Lock "cinder-quobyte-7d925e6a-eacc-4067-8200-2fe5669d313f" released by "delete_volume" :: held 0.817s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] Created reservations ['3a197382-d1b1-4cb9-b1f0-995f02dc02eb', '86ea8839-9978-4d01-86e7-586f0755bc2e', '55f46907-cf85-4205-99f0-d3a8d57269d1', '42421f37-9324-4b66-9da5-8e0457aff764'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:39 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:19:39 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Acquiring lock "cinder-0de111d1-d977-4f64-ad34-633cc283f963-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-0de111d1-d977-4f64-ad34-633cc283f963-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Acquiring lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Acquiring lock "cinder-quobyte-0de111d1-d977-4f64-ad34-633cc283f963" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-quobyte-0de111d1-d977-4f64-ad34-633cc283f963" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Deleting offline snapshot 0de111d1-d977-4f64-ad34-633cc283f963 of volume 44ade2a1-478c-4211-bdae-6306ca6b948d {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] snapshot_file for this snap is: volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf37279-39d0-457b-9ec4-0c65815f4b40]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:40 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.357s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:19:40 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] Deleted volume successfully. Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c2423f28-3e91-471f-a853-13e98d15d816 tempest-AttachVolumeTestJSON-1079889311 None] Lock "cinder-7d925e6a-eacc-4067-8200-2fe5669d313f-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "cinder-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] Lock "cinder-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:40 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963 Jul 14 21:19:40 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "cinder-quobyte-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] Lock "cinder-quobyte-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa" acquired by "delete_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9786b146-cea1-47ce-9f64-e2bf71efa560]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:40 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa Jul 14 21:19:40 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:40 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963" returned: 0 in 0.621s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44ade2a1-478c-4211-bdae-6306ca6b948d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bd97bc-7460-48cd-9c36-16b49033666a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-90755b7e-13d9-403b-abe4-c24e36492fa2 tempest-VolumesActionsTest-346411820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-90755b7e-13d9-403b-abe4-c24e36492fa2 tempest-VolumesActionsTest-346411820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:40 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 Jul 14 21:19:40 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:40 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa" returned: 0 in 0.513s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a8632f-c2c3-405b-a5c8-adfb6b81f595]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-90755b7e-13d9-403b-abe4-c24e36492fa2 tempest-VolumesActionsTest-346411820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:40 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa Jul 14 21:19:40 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:41 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c Jul 14 21:19:41 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:41 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4" returned: 0 in 0.460s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44ade2a1-478c-4211-bdae-6306ca6b948d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:41 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963 Jul 14 21:19:41 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:41 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa" returned: 0 in 0.367s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] Lock "cinder-quobyte-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa" released by "delete_volume" :: held 0.931s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:41 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-90755b7e-13d9-403b-abe4-c24e36492fa2 tempest-VolumesActionsTest-346411820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c" returned: 0 in 0.400s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9b3cea-b9c4-42ab-a66c-f21b8288d3c4]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-90755b7e-13d9-403b-abe4-c24e36492fa2 tempest-VolumesActionsTest-346411820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] Created reservations ['284fed42-1366-476f-bc4f-44a64df7a05e', '2f99ebd3-d69f-41b0-95a3-87d360dd03d6', '48d109ed-e11d-4962-b5e0-d1d5444eba03', 'f01b2407-7f90-4fb2-b4e1-a6fd6e722546'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:19:41 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c Jul 14 21:19:41 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:41 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:19:41 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:41 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963" returned: 0 in 0.624s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:41 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-90755b7e-13d9-403b-abe4-c24e36492fa2 tempest-VolumesActionsTest-346411820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c" returned: 0 in 0.532s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:41 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963 Jul 14 21:19:41 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-90755b7e-13d9-403b-abe4-c24e36492fa2 tempest-VolumesActionsTest-346411820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.4230bed8-d216-4717-b932-72be58560bffuqqy7oh2.img {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:41 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.4230bed8-d216-4717-b932-72be58560bffuqqy7oh2.img Jul 14 21:19:41 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:41 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.490s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:41 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:19:41 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] Deleted volume successfully. Jul 14 21:19:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b81577d3-6d3c-4df9-93b8-2f194a97a38b tempest-AttachVolumeTestJSON-1079889311 None] Lock "cinder-b334bcf4-bdb0-487b-bbdb-6aab32dcd1fa-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:42 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.0de111d1-d977-4f64-ad34-633cc283f963" returned: 0 in 0.440s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-quobyte-0de111d1-d977-4f64-ad34-633cc283f963" released by "_delete_snapshot" :: held 2.290s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" released by "delete_snapshot" :: held 2.338s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:42 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Created reservations ['28e5da05-5005-4f4a-8e3c-72a2fa3bc06f', 'cd54a88e-c4ec-416a-9ecd-cce52adb715c', '47433bad-e394-4ea2-a987-a203da4cc81c', 'ec9df996-27f1-4a17-8d1a-56a528374891'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:19:42 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Delete snapshot completed successfully. Jul 14 21:19:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1c5d7adf-858d-488b-a66a-2ce7f2c42769 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-0de111d1-d977-4f64-ad34-633cc283f963-delete_snapshot" released by "delete_snapshot" :: held 2.821s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:19:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-27547d5d-3935-45ef-aeec-0e5168e0d3ec tempest-SnapshotsActionsTest-1281282332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:19:47 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-90755b7e-13d9-403b-abe4-c24e36492fa2 tempest-VolumesActionsTest-346411820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.4230bed8-d216-4717-b932-72be58560bffuqqy7oh2.img" returned: 0 in 6.015s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:47 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3defbd0-e149-4165-98f4-96b42362e2e5]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:19:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-90755b7e-13d9-403b-abe4-c24e36492fa2 tempest-VolumesActionsTest-346411820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:19:47 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c Jul 14 21:19:47 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:19:48 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Jul 14 21:19:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-90755b7e-13d9-403b-abe4-c24e36492fa2 tempest-VolumesActionsTest-346411820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c" returned: 0 in 0.557s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:19:48 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-90755b7e-13d9-403b-abe4-c24e36492fa2 tempest-VolumesActionsTest-346411820 None] Image conversion details: src /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.4230bed8-d216-4717-b932-72be58560bffuqqy7oh2.img {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:19:48 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-90755b7e-13d9-403b-abe4-c24e36492fa2 tempest-VolumesActionsTest-346411820 None] Converted 1024.00 MB image at 170.22 MB/s Jul 14 21:19:48 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-90755b7e-13d9-403b-abe4-c24e36492fa2 tempest-VolumesActionsTest-346411820 None] 4230bed8-d216-4717-b932-72be58560bff was raw, no need to convert to raw {{(pid=88300) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 14 21:19:58 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=34,cinder:UPDATE=50,cinder:INSERT=12,cinder:DELETE=2 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:19:58 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=41,cinder:DELETE=3,cinder:UPDATE=31,cinder:INSERT=10 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:20:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-90755b7e-13d9-403b-abe4-c24e36492fa2 tempest-VolumesActionsTest-346411820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.468s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-90755b7e-13d9-403b-abe4-c24e36492fa2 tempest-VolumesActionsTest-346411820 None] Uploaded volume to glance image-id: 4230bed8-d216-4717-b932-72be58560bff. {{(pid=88300) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 14 21:20:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-27547d5d-3935-45ef-aeec-0e5168e0d3ec tempest-SnapshotsActionsTest-1281282332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 27.138s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-27547d5d-3935-45ef-aeec-0e5168e0d3ec tempest-SnapshotsActionsTest-1281282332 None] Creating offline snapshot c3149a8a-2082-4228-b096-2eed82f946ad of volume 44ade2a1-478c-4211-bdae-6306ca6b948d {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:20:11 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-90755b7e-13d9-403b-abe4-c24e36492fa2 tempest-VolumesActionsTest-346411820 None] Copy volume to image completed successfully. Jul 14 21:20:11 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[89174bdb-ef0c-4638-8ffe-59a5cb8eec6d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-27547d5d-3935-45ef-aeec-0e5168e0d3ec tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:11 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 Jul 14 21:20:11 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:12 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-27547d5d-3935-45ef-aeec-0e5168e0d3ec tempest-SnapshotsActionsTest-1281282332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4" returned: 0 in 0.791s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-27547d5d-3935-45ef-aeec-0e5168e0d3ec tempest-SnapshotsActionsTest-1281282332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44ade2a1-478c-4211-bdae-6306ca6b948d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:20:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-27547d5d-3935-45ef-aeec-0e5168e0d3ec tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:12 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad 1G Jul 14 21:20:12 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:13 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-27547d5d-3935-45ef-aeec-0e5168e0d3ec tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad 1G" returned: 0 in 0.809s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-27547d5d-3935-45ef-aeec-0e5168e0d3ec tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:13 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad Jul 14 21:20:13 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:13 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-27547d5d-3935-45ef-aeec-0e5168e0d3ec tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad" returned: 0 in 0.451s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:13 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-27547d5d-3935-45ef-aeec-0e5168e0d3ec tempest-SnapshotsActionsTest-1281282332 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad is being set with open permissions: ugo+rw Jul 14 21:20:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-27547d5d-3935-45ef-aeec-0e5168e0d3ec tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:13 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad Jul 14 21:20:13 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:13 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-27547d5d-3935-45ef-aeec-0e5168e0d3ec tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad" returned: 0 in 0.309s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-27547d5d-3935-45ef-aeec-0e5168e0d3ec tempest-SnapshotsActionsTest-1281282332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.627s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.722s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:13 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ac9152-0523-4a0b-a76c-83212daf426d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:14 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-27547d5d-3935-45ef-aeec-0e5168e0d3ec tempest-SnapshotsActionsTest-1281282332 None] Create snapshot completed successfully Jul 14 21:20:14 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c Jul 14 21:20:14 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:14 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c" returned: 0 in 0.502s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:14 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6f5288-da0d-48aa-8df1-d7690480107f]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:14 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c Jul 14 21:20:14 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:14 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c" returned: 0 in 0.421s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.41b5f81a-6278-4580-afab-3cd06b3b5204nplhgbir.img {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:14 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.41b5f81a-6278-4580-afab-3cd06b3b5204nplhgbir.img Jul 14 21:20:14 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Acquiring lock "cinder-c3149a8a-2082-4228-b096-2eed82f946ad-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-c3149a8a-2082-4228-b096-2eed82f946ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Acquiring lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Acquiring lock "cinder-quobyte-c3149a8a-2082-4228-b096-2eed82f946ad" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-quobyte-c3149a8a-2082-4228-b096-2eed82f946ad" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Deleting offline snapshot c3149a8a-2082-4228-b096-2eed82f946ad of volume 44ade2a1-478c-4211-bdae-6306ca6b948d {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:20:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] snapshot_file for this snap is: volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:20:15 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a25c03a-9bec-42d0-981d-094d56693630]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:15 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad Jul 14 21:20:15 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:16 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad" returned: 0 in 0.894s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44ade2a1-478c-4211-bdae-6306ca6b948d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:20:16 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e656432-9938-4627-9d31-6e34b2f29f4b]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:16 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 Jul 14 21:20:16 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:17 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4" returned: 0 in 1.391s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44ade2a1-478c-4211-bdae-6306ca6b948d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:20:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:17 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad Jul 14 21:20:17 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:19 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad" returned: 0 in 1.708s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:19 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad Jul 14 21:20:19 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] Acquiring lock "cinder-cad918db-789b-4ee0-afea-82fa1bb68402-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] Lock "cinder-cad918db-789b-4ee0-afea-82fa1bb68402-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] Acquiring lock "cinder-quobyte-cad918db-789b-4ee0-afea-82fa1bb68402" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] Lock "cinder-quobyte-cad918db-789b-4ee0-afea-82fa1bb68402" acquired by "delete_volume" :: waited 0.036s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:20 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.c3149a8a-2082-4228-b096-2eed82f946ad" returned: 0 in 1.019s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:20 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61bfc1e-df85-4098-8c4b-6056f794dfc2]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cad918db-789b-4ee0-afea-82fa1bb68402 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-quobyte-c3149a8a-2082-4228-b096-2eed82f946ad" released by "_delete_snapshot" :: held 5.362s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" released by "delete_snapshot" :: held 5.424s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:20 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Created reservations ['72ba3b21-0470-4c53-9cd6-ed3ff4d1371b', '627705a0-4b34-4431-abbe-4ebdbf73376c', 'daa2c881-172d-4a7a-a70b-767529a540f6', 'd5dde993-01e4-4b60-9229-aad4fc3ecb47'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:20:20 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cad918db-789b-4ee0-afea-82fa1bb68402 Jul 14 21:20:20 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:21 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Delete snapshot completed successfully. Jul 14 21:20:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5cc9b277-dbc1-41a4-8476-2b00a694dd24 tempest-SnapshotsActionsTest-894881178 None] Lock "cinder-c3149a8a-2082-4228-b096-2eed82f946ad-delete_snapshot" released by "delete_snapshot" :: held 5.935s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:21 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cad918db-789b-4ee0-afea-82fa1bb68402" returned: 0 in 1.039s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cad918db-789b-4ee0-afea-82fa1bb68402 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:21 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cad918db-789b-4ee0-afea-82fa1bb68402 Jul 14 21:20:21 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:21 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.41b5f81a-6278-4580-afab-3cd06b3b5204nplhgbir.img" returned: 0 in 6.995s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:21 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[62efe4b8-9a09-464d-9034-0abf745ee308]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:22 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c Jul 14 21:20:22 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:22 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cad918db-789b-4ee0-afea-82fa1bb68402" returned: 0 in 0.629s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] Lock "cinder-quobyte-cad918db-789b-4ee0-afea-82fa1bb68402" released by "delete_volume" :: held 1.843s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] Created reservations ['91e98fab-fa93-452c-a9a0-533c284f18f3', '1554bed3-2c12-42b6-817c-15f56279feec', '0771668b-2f6b-4773-8182-384677f29be5', 'aa1bb033-d04b-4d51-b541-c2248b4ebe57'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:22 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:20:22 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] Acquiring lock "cinder-eeef90f3-249a-40c7-b74a-039623c164d4-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] Lock "cinder-eeef90f3-249a-40c7-b74a-039623c164d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] Acquiring lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] Lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] Acquiring lock "cinder-quobyte-eeef90f3-249a-40c7-b74a-039623c164d4" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] Lock "cinder-quobyte-eeef90f3-249a-40c7-b74a-039623c164d4" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] Deleting offline snapshot eeef90f3-249a-40c7-b74a-039623c164d4 of volume 44ade2a1-478c-4211-bdae-6306ca6b948d {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] snapshot_file for this snap is: volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:20:22 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.357s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:20:22 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] Deleted volume successfully. Jul 14 21:20:22 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6921c81-b620-4be0-91bf-32072df54be5]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c" returned: 0 in 0.768s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] Image conversion details: src /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c, size 1024.00 MB, duration 7.00 sec, destination /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.41b5f81a-6278-4580-afab-3cd06b3b5204nplhgbir.img {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:20:22 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] Converted 1024.00 MB image at 146.35 MB/s Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] 41b5f81a-6278-4580-afab-3cd06b3b5204 was raw, converting to qcow2 {{(pid=88300) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-280abf46-5851-4d94-ae7d-ddfc7a98010f tempest-AttachVolumeShelveTestJSON-1595785281 None] Lock "cinder-cad918db-789b-4ee0-afea-82fa1bb68402-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[365ce74e-99b4-434a-a53f-01f5a6de705a]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.41b5f81a-6278-4580-afab-3cd06b3b5204nplhgbir.img {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:22 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 Jul 14 21:20:22 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:22 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.41b5f81a-6278-4580-afab-3cd06b3b5204nplhgbir.img Jul 14 21:20:22 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:23 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4" returned: 0 in 0.474s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44ade2a1-478c-4211-bdae-6306ca6b948d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:20:23 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.41b5f81a-6278-4580-afab-3cd06b3b5204nplhgbir.img" returned: 0 in 0.425s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.41b5f81a-6278-4580-afab-3cd06b3b5204nplhgbir.img {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:23 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[721b54d9-77d7-4cf2-b1e2-1edf02a1187f]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:23 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.41b5f81a-6278-4580-afab-3cd06b3b5204nplhgbir.img Jul 14 21:20:23 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:23 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d Jul 14 21:20:23 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:23 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.41b5f81a-6278-4580-afab-3cd06b3b5204nplhgbir.img" returned: 1 in 0.419s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.41b5f81a-6278-4580-afab-3cd06b3b5204nplhgbir.img' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:20:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.41b5f81a-6278-4580-afab-3cd06b3b5204nplhgbir.img /opt/stack/data/cinder/conversion/vol_upload_11tr9ppm {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:23 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.41b5f81a-6278-4580-afab-3cd06b3b5204nplhgbir.img /opt/stack/data/cinder/conversion/vol_upload_11tr9ppm Jul 14 21:20:23 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:23 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d" returned: 0 in 0.468s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:23 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 Jul 14 21:20:23 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:23 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.41b5f81a-6278-4580-afab-3cd06b3b5204nplhgbir.img /opt/stack/data/cinder/conversion/vol_upload_11tr9ppm" returned: 0 in 0.348s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:23 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] Image conversion details: src /opt/stack/data/cinder/conversion/f8d65fbb-7da5-409e-a454-646c750b2b3c.temp_image.41b5f81a-6278-4580-afab-3cd06b3b5204nplhgbir.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_11tr9ppm {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:20:23 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 14 21:20:23 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3742a9-fc04-4469-ab27-21482fda160a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_11tr9ppm {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:24 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_11tr9ppm Jul 14 21:20:24 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:24 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4" returned: 0 in 0.595s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:24 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4 Jul 14 21:20:24 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:24 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_11tr9ppm" returned: 0 in 0.439s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:24 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d.eeef90f3-249a-40c7-b74a-039623c164d4" returned: 0 in 0.307s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] Lock "cinder-quobyte-eeef90f3-249a-40c7-b74a-039623c164d4" released by "_delete_snapshot" :: held 2.017s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] Lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" released by "delete_snapshot" :: held 2.057s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:24 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] Created reservations ['640c4fb3-5211-47e7-9bf5-222f208fc3c1', 'defde883-d52a-4046-ac35-995c81868449', '56895231-82f1-4c4c-af4c-76697ce9ef19', '6eb1a06d-c316-4927-816c-54e227524131'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:20:24 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] Delete snapshot completed successfully. Jul 14 21:20:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-57a69f10-929a-47ec-9881-1f46c261070d tempest-SnapshotsActionsTest-1281282332 None] Lock "cinder-eeef90f3-249a-40c7-b74a-039623c164d4-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] Acquiring lock "cinder-44ade2a1-478c-4211-bdae-6306ca6b948d-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] Lock "cinder-44ade2a1-478c-4211-bdae-6306ca6b948d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] Acquiring lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] Lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" acquired by "delete_volume" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.995s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] Uploaded volume to glance image-id: 41b5f81a-6278-4580-afab-3cd06b3b5204. {{(pid=88300) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 14 21:20:25 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34f6348-a0e1-46eb-ac2e-521af4a3e89f]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:26 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a267aa12-21b4-45ac-af11-b0c9042305c0 tempest-VolumesActionsTest-346411820 None] Copy volume to image completed successfully. Jul 14 21:20:26 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d Jul 14 21:20:26 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:26 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d" returned: 0 in 0.454s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:26 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d Jul 14 21:20:26 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:26 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-44ade2a1-478c-4211-bdae-6306ca6b948d" returned: 0 in 0.269s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:26 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] Lock "cinder-quobyte-44ade2a1-478c-4211-bdae-6306ca6b948d" released by "delete_volume" :: held 0.787s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:26 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] Created reservations ['a9571898-968a-4a75-9d1f-3629d31d98b4', '89b73651-547e-4b72-9d13-6a2e41d67590', '8a7b73a8-b80c-46e0-afa7-2e3be14ec3db', 'f57bc7e7-00d8-4b64-88df-f0d4593a36a1'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:20:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:26 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:26 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:26 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:20:26 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] Acquiring lock "cinder-f8d65fbb-7da5-409e-a454-646c750b2b3c-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] Lock "cinder-f8d65fbb-7da5-409e-a454-646c750b2b3c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:27 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] Acquiring lock "cinder-quobyte-f8d65fbb-7da5-409e-a454-646c750b2b3c" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.337s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:27 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:20:27 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] Deleted volume successfully. Jul 14 21:20:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] Lock "cinder-quobyte-f8d65fbb-7da5-409e-a454-646c750b2b3c" acquired by "delete_volume" :: waited 0.037s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4218c904-eef5-4448-9595-24ec8f93323a tempest-SnapshotsActionsTest-1281282332 None] Lock "cinder-44ade2a1-478c-4211-bdae-6306ca6b948d-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:27 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d3e188-1a27-4858-ba6b-1028399492d3]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:27 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c Jul 14 21:20:27 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:27 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c" returned: 0 in 0.423s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:27 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c Jul 14 21:20:27 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:27 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f8d65fbb-7da5-409e-a454-646c750b2b3c" returned: 0 in 0.244s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] Lock "cinder-quobyte-f8d65fbb-7da5-409e-a454-646c750b2b3c" released by "delete_volume" :: held 0.732s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:28 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] Created reservations ['c2d21c57-4cda-4229-82c7-a2ac576fc1e0', '257b517f-53a7-49fe-baa9-bfdd353208e6', 'e083d651-0bac-4397-9d79-79a40eafd524', '76cdf987-4ec0-4aae-8295-2944360723a5'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:20:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:28 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:28 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:28 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:20:28 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:28 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.297s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:28 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:20:28 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] Deleted volume successfully. Jul 14 21:20:28 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f9519129-a1d3-4653-9906-f598c4d86417 tempest-VolumesActionsTest-346411820 None] Lock "cinder-f8d65fbb-7da5-409e-a454-646c750b2b3c-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:31 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-3b04858c-c2d9-48f3-bbb4-5b9b1f28c519 tempest-GroupSnapshotsTest-1411126106 None] Group tempest-GroupSnapshotsTest-Group-765722847: creating Jul 14 21:20:31 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-3b04858c-c2d9-48f3-bbb4-5b9b1f28c519 tempest-GroupSnapshotsTest-1411126106 None] Group tempest-GroupSnapshotsTest-Group-765722847: created successfully Jul 14 21:20:31 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-3b04858c-c2d9-48f3-bbb4-5b9b1f28c519 tempest-GroupSnapshotsTest-1411126106 None] Create group completed successfully. Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Flow 'volume_create_manager' (a25f522b-b367-444d-8fc5-cdf4aa6c39ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a5e257-0fb0-49aa-ba6d-df94ecfce5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a5e257-0fb0-49aa-ba6d-df94ecfce5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-470887417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83866c2f-701d-4860-89f3-543c0418c415,host='devstack@QuobyteHD#QuobyteHD',id=e44db337-78af-4563-bba7-053edc0f619f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7876f2336b3043df91787bc89606eb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:20:34Z,use_quota=True,user_id='0835bc9470b341c993668ed0e1f0d8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc910818-5f23-4ac4-98b5-25a4a31ea20d),volume_type_id=fc910818-5f23-4ac4-98b5-25a4a31ea20d)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0688a709-e0d3-4fc1-ada0-b5698892ca7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0688a709-e0d3-4fc1-ada0-b5698892ca7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2884ae-acc0-4c28-b50a-c55e5b091f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2884ae-acc0-4c28-b50a-c55e5b091f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e44db337-78af-4563-bba7-053edc0f619f', 'volume_name': 'volume-e44db337-78af-4563-bba7-053edc0f619f', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5c2f22-9de1-4788-98e5-388a7acfcdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5c2f22-9de1-4788-98e5-388a7acfcdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14c5bfb-156a-4dab-a7bb-875ecbc70312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:33 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Volume e44db337-78af-4563-bba7-053edc0f619f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e44db337-78af-4563-bba7-053edc0f619f', 'volume_size': 1} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=83866c2f-701d-4860-89f3-543c0418c415,created_at=2026-07-14T19:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-470887417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83866c2f-701d-4860-89f3-543c0418c415,host='devstack@QuobyteHD#QuobyteHD',id=e44db337-78af-4563-bba7-053edc0f619f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7876f2336b3043df91787bc89606eb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:20:34Z,use_quota=True,user_id='0835bc9470b341c993668ed0e1f0d8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc910818-5f23-4ac4-98b5-25a4a31ea20d),volume_type_id=fc910818-5f23-4ac4-98b5-25a4a31ea20d)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Creating volume e44db337-78af-4563-bba7-053edc0f619f {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:20:33 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:20:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:33 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f 1073741824 Jul 14 21:20:33 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:34 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f 1073741824" returned: 0 in 0.524s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:34 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f Jul 14 21:20:34 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:34 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f" returned: 0 in 0.255s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:34 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:20:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14c5bfb-156a-4dab-a7bb-875ecbc70312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e44db337-78af-4563-bba7-053edc0f619f', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fcb1b3-11e3-4e16-9d29-baadebb60f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:34 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Volume volume-e44db337-78af-4563-bba7-053edc0f619f (e44db337-78af-4563-bba7-053edc0f619f): created successfully Jul 14 21:20:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fcb1b3-11e3-4e16-9d29-baadebb60f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Flow 'volume_create_manager' (a25f522b-b367-444d-8fc5-cdf4aa6c39ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:20:34 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-feb55c00-3615-47d4-a450-ca1fb072ced8 tempest-GroupSnapshotsTest-1411126106 None] Created volume successfully. Jul 14 21:20:35 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] GroupSnapshot 63746c0b-8ffa-4911-832e-09f072752300: creating. Jul 14 21:20:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] Group snapshot 63746c0b-8ffa-4911-832e-09f072752300: creating. {{(pid=88300) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 14 21:20:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] Creating offline snapshot 1e8cce75-08e4-430a-b869-fdac8cf601f0 of volume e44db337-78af-4563-bba7-053edc0f619f {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:20:35 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d60827-a8de-4c77-8bba-204466f9ca98]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:35 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f Jul 14 21:20:35 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:35 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f" returned: 0 in 0.485s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:35 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0 1G Jul 14 21:20:35 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:36 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0 1G" returned: 0 in 0.497s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e44db337-78af-4563-bba7-053edc0f619f -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:36 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e44db337-78af-4563-bba7-053edc0f619f -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0 Jul 14 21:20:36 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Flow 'volume_create_manager' (6a8859ca-e357-4030-8d15-962c12628647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74c7d0e-913e-45c9-b3c2-bee607b35e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74c7d0e-913e-45c9-b3c2-bee607b35e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-706966151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54743c8-c62a-4a8e-8af2-0ad61f3c3430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eed13347962475b89592b1bb7afa710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:20:36Z,use_quota=True,user_id='b5492476912044dd8ab63f8b30370fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee32844-f3f0-40ab-b89f-b5462b7bd98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee32844-f3f0-40ab-b89f-b5462b7bd98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a4b2f2-ad6d-4214-9911-dfe00751268d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a4b2f2-ad6d-4214-9911-dfe00751268d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f54743c8-c62a-4a8e-8af2-0ad61f3c3430', 'volume_name': 'volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71e05db-7a65-4b02-bb37-8f66f7c609e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71e05db-7a65-4b02-bb37-8f66f7c609e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fcadc52-f8b0-47ba-9032-e96f2f19ec84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:36 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Volume f54743c8-c62a-4a8e-8af2-0ad61f3c3430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430', 'volume_size': 1} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:20:36 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Flow 'volume_create_manager' (04ba7f58-257e-489a-a25c-8b2068229c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a27b1d-a447-424a-9dcc-ba8be038a36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e44db337-78af-4563-bba7-053edc0f619f -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0" returned: 0 in 0.430s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:36 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:36 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:20:36 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a27b1d-a447-424a-9dcc-ba8be038a36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1357329758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6eeae0d-d0e1-4d36-abbe-54d778445177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e3ec1e91424dd694bf6009f3672b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:20:36Z,use_quota=True,user_id='34f199c456d64f4cb2d1deb4011e6abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:36 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0 Jul 14 21:20:36 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3069b910-8eea-414c-8a45-5492eb35e538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3069b910-8eea-414c-8a45-5492eb35e538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97da5112-f1e8-494c-a35b-ac493473b4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97da5112-f1e8-494c-a35b-ac493473b4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6eeae0d-d0e1-4d36-abbe-54d778445177', 'volume_name': 'volume-b6eeae0d-d0e1-4d36-abbe-54d778445177', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8f1011-aa67-4698-a96d-150f86e1c4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8f1011-aa67-4698-a96d-150f86e1c4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c404f70b-c284-44e7-91c2-cac678442fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:36 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Volume b6eeae0d-d0e1-4d36-abbe-54d778445177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6eeae0d-d0e1-4d36-abbe-54d778445177', 'volume_size': 1} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:36 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.323s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 28 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:20:36 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0" returned: 0 in 0.335s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:36 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.info Jul 14 21:20:36 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:37 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.info" returned: 0 in 0.269s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:37 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 21:20:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:37 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.info Jul 14 21:20:37 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:37 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.info" returned: 0 in 0.246s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.368s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.959s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-706966151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54743c8-c62a-4a8e-8af2-0ad61f3c3430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eed13347962475b89592b1bb7afa710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:20:36Z,use_quota=True,user_id='b5492476912044dd8ab63f8b30370fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:20:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Creating volume f54743c8-c62a-4a8e-8af2-0ad61f3c3430 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:20:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:20:37 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:20:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:37 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 1073741824 Jul 14 21:20:37 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:37 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-780c0df0-0251-4e62-bbd9-ce3a9527508b tempest-GroupSnapshotsTest-1411126106 None] group_snapshot 63746c0b-8ffa-4911-832e-09f072752300: created successfully Jul 14 21:20:37 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 1073741824" returned: 0 in 0.458s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:38 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 Jul 14 21:20:38 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:38 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430" returned: 0 in 0.248s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.583s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1357329758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6eeae0d-d0e1-4d36-abbe-54d778445177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e3ec1e91424dd694bf6009f3672b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:20:36Z,use_quota=True,user_id='34f199c456d64f4cb2d1deb4011e6abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Creating volume b6eeae0d-d0e1-4d36-abbe-54d778445177 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:20:38 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b6eeae0d-d0e1-4d36-abbe-54d778445177 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:38 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b6eeae0d-d0e1-4d36-abbe-54d778445177 1073741824 Jul 14 21:20:38 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fcadc52-f8b0-47ba-9032-e96f2f19ec84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef42b30b-c91c-45b6-9a08-76eccefee8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:38 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Volume volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 (f54743c8-c62a-4a8e-8af2-0ad61f3c3430): created successfully Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef42b30b-c91c-45b6-9a08-76eccefee8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Flow 'volume_create_manager' (6a8859ca-e357-4030-8d15-962c12628647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:20:38 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d08ed604-d9ff-4874-9a29-7218f54f6f85 tempest-VolumesCloneTest-1429569658 None] Created volume successfully. Jul 14 21:20:38 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b6eeae0d-d0e1-4d36-abbe-54d778445177 1073741824" returned: 0 in 0.496s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b6eeae0d-d0e1-4d36-abbe-54d778445177 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:38 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b6eeae0d-d0e1-4d36-abbe-54d778445177 Jul 14 21:20:38 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:39 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b6eeae0d-d0e1-4d36-abbe-54d778445177" returned: 0 in 0.271s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c404f70b-c284-44e7-91c2-cac678442fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6eeae0d-d0e1-4d36-abbe-54d778445177', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6e2fa6-a9ef-4ac5-88d3-2ef64ea4b8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "cinder-quobyte-1e8cce75-08e4-430a-b869-fdac8cf601f0-cf4fedbd-7697-4648-a042-1be9781ad7db" by "_create_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:39 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Volume volume-b6eeae0d-d0e1-4d36-abbe-54d778445177 (b6eeae0d-d0e1-4d36-abbe-54d778445177): created successfully Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6e2fa6-a9ef-4ac5-88d3-2ef64ea4b8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Flow 'volume_create_manager' (04ba7f58-257e-489a-a25c-8b2068229c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:20:39 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-233d7e82-1e57-49b3-8956-d9c05af43eb2 tempest-AttachVolumeNegativeTest-850271826 None] Created volume successfully. Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-1e8cce75-08e4-430a-b869-fdac8cf601f0-cf4fedbd-7697-4648-a042-1be9781ad7db" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Creating volume cf4fedbd-7697-4648-a042-1be9781ad7db from snapshot 1e8cce75-08e4-430a-b869-fdac8cf601f0 {{(pid=88300) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "cinder-quobyte-cf4fedbd-7697-4648-a042-1be9781ad7db" by "_copy_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-cf4fedbd-7697-4648-a042-1be9781ad7db" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] snapshot: 1e8cce75-08e4-430a-b869-fdac8cf601f0, volume: cf4fedbd-7697-4648-a042-1be9781ad7db, {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae3c836-6709-425d-9900-d6eb023db6bc]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:39 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0 Jul 14 21:20:39 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:39 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0" returned: 0 in 0.413s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e44db337-78af-4563-bba7-053edc0f619f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Creating direct copy from snapshot {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ac345d-001c-4fc2-bd0e-abdb6f2be475]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:39 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f Jul 14 21:20:39 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:20:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Flow 'volume_create_manager' (d4cb9e2f-38dd-4e74-a307-ee9632c6f0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a990aff8-07d6-4ab1-a89b-ebedcf6985c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a990aff8-07d6-4ab1-a89b-ebedcf6985c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-613824694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4fdc7b-1983-42ba-91dd-9b32bc69c26e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eed13347962475b89592b1bb7afa710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:20:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f54743c8-c62a-4a8e-8af2-0ad61f3c3430,status='creating',terminated_at=None,updated_at=2026-07-14T19:20:40Z,use_quota=True,user_id='b5492476912044dd8ab63f8b30370fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee43fab-1fd5-4013-8bb2-55f918a36eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee43fab-1fd5-4013-8bb2-55f918a36eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e846631-fc32-4c52-babb-3aeaed81efa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e846631-fc32-4c52-babb-3aeaed81efa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'aa4fdc7b-1983-42ba-91dd-9b32bc69c26e', 'volume_name': 'volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e', 'volume_size': 2, 'source_volid': 'f54743c8-c62a-4a8e-8af2-0ad61f3c3430', 'source_volstatus': 'available'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa032a9-5894-40ee-9bc6-cef449044449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa032a9-5894-40ee-9bc6-cef449044449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbaeaa5f-cc9c-4c20-9259-c965873e6c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:40 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Volume aa4fdc7b-1983-42ba-91dd-9b32bc69c26e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e', 'volume_size': 2, 'source_volid': 'f54743c8-c62a-4a8e-8af2-0ad61f3c3430', 'source_volstatus': 'available'} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Flow 'volume_create_manager' (3d4f748a-9051-4881-b03f-773762fdb8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918fee2a-befa-406b-8e86-305ab6814394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918fee2a-befa-406b-8e86-305ab6814394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-188300497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fa78fe-f545-4fdc-9a94-ed0c52b050db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0cb0919e7974bfe96e8c1bfdccd236d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:20:40Z,use_quota=True,user_id='fb50fc4e9c0c41969d978cf2b227c1e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a3ec36-ccbd-45cd-982f-7804f66fe431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a3ec36-ccbd-45cd-982f-7804f66fe431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19c691f-6d77-4cbe-812c-d3b238364f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19c691f-6d77-4cbe-812c-d3b238364f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6fa78fe-f545-4fdc-9a94-ed0c52b050db', 'volume_name': 'volume-f6fa78fe-f545-4fdc-9a94-ed0c52b050db', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:40 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7053049c-0a2d-4a14-8f43-72aacf7a16de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7053049c-0a2d-4a14-8f43-72aacf7a16de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31db95b0-f4f9-4be0-a5f0-8e638672543c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:40 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Volume f6fa78fe-f545-4fdc-9a94-ed0c52b050db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6fa78fe-f545-4fdc-9a94-ed0c52b050db', 'volume_size': 1} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f" returned: 0 in 0.536s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG cinder.utils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Path /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cf4fedbd-7697-4648-a042-1be9781ad7db not found in is_blk_device check {{(pid=88300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cf4fedbd-7697-4648-a042-1be9781ad7db {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:40 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cf4fedbd-7697-4648-a042-1be9781ad7db Jul 14 21:20:40 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-831a22d6-3a6e-40e6-88f0-da0279f089e4 req-3bb7ed03-f75d-4748-9857-782381c13322 tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:44 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cf4fedbd-7697-4648-a042-1be9781ad7db" returned: 0 in 4.193s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:44 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fc3844-9e77-469f-9716-568e44055687]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:44 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f Jul 14 21:20:44 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:44 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f" returned: 0 in 0.532s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:44 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Image conversion details: src /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f, size 1024.00 MB, duration 4.19 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cf4fedbd-7697-4648-a042-1be9781ad7db {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:20:44 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Converted 1024.00 MB image at 244.14 MB/s Jul 14 21:20:44 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cf4fedbd-7697-4648-a042-1be9781ad7db is being set with open permissions: ugo+rw: NotImplementedError Jul 14 21:20:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cf4fedbd-7697-4648-a042-1be9781ad7db {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:45 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cf4fedbd-7697-4648-a042-1be9781ad7db Jul 14 21:20:45 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:45 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cf4fedbd-7697-4648-a042-1be9781ad7db" returned: 0 in 0.233s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:45 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-cf4fedbd-7697-4648-a042-1be9781ad7db" released by "_copy_volume_from_snapshot" :: held 6.058s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:45 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-1e8cce75-08e4-430a-b869-fdac8cf601f0-cf4fedbd-7697-4648-a042-1be9781ad7db" released by "_create_volume_from_snapshot" :: held 6.101s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.143s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.153s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:45 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Cloning volume f54743c8-c62a-4a8e-8af2-0ad61f3c3430 to volume aa4fdc7b-1983-42ba-91dd-9b32bc69c26e Jul 14 21:20:45 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Creating offline snapshot c50c0a05-7e0c-454e-889d-7c652571a18e of volume f54743c8-c62a-4a8e-8af2-0ad61f3c3430 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:20:45 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[144389ff-ae6b-402a-a4b7-19935d44c7b6]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:45 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-22ef0bcb-cc89-4966-bd26-a758da2ebb30 tempest-GroupSnapshotsTest-1411126106 None] Create group from source-snapshot-63746c0b-8ffa-4911-832e-09f072752300 completed successfully. Jul 14 21:20:45 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 Jul 14 21:20:45 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:45 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430" returned: 0 in 0.348s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:45 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e 1G Jul 14 21:20:45 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:46 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e 1G" returned: 0 in 0.413s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:46 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e Jul 14 21:20:46 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:46 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e" returned: 0 in 0.290s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:46 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e is being set with open permissions: ugo+rw Jul 14 21:20:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:46 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e Jul 14 21:20:46 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "cinder-quobyte-cf4fedbd-7697-4648-a042-1be9781ad7db" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-cf4fedbd-7697-4648-a042-1be9781ad7db" acquired by "delete_volume" :: waited 0.016s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:46 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf46386-84e3-4dc0-a10f-d2a9229e49cb]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cf4fedbd-7697-4648-a042-1be9781ad7db {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:46 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e" returned: 0 in 0.268s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:46 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cf4fedbd-7697-4648-a042-1be9781ad7db Jul 14 21:20:46 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:46 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.info Jul 14 21:20:46 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:46 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.info" returned: 0 in 0.247s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:46 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.info is being set with open permissions: ugo+rw Jul 14 21:20:46 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cf4fedbd-7697-4648-a042-1be9781ad7db" returned: 0 in 0.376s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cf4fedbd-7697-4648-a042-1be9781ad7db {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:46 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.info Jul 14 21:20:46 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:46 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cf4fedbd-7697-4648-a042-1be9781ad7db Jul 14 21:20:46 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:47 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.info" returned: 0 in 0.252s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:47 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Acquiring lock "cinder-quobyte-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e" by "_copy_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cf4fedbd-7697-4648-a042-1be9781ad7db" returned: 0 in 0.269s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Lock "cinder-quobyte-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] snapshot: c50c0a05-7e0c-454e-889d-7c652571a18e, volume: aa4fdc7b-1983-42ba-91dd-9b32bc69c26e, {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-cf4fedbd-7697-4648-a042-1be9781ad7db" released by "delete_volume" :: held 0.710s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b75a51f-8bda-432a-ad1a-303bd151d5d3]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] Created reservations ['0bcbf517-504a-42a5-8b9b-46cea8a1fea4'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:20:47 devstack cinder-volume[88300]: WARNING cinder.quota [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1217999563 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1217999563, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:20:47 devstack cinder-volume[88300]: WARNING cinder.quota [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1217999563 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1217999563, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] Created reservations ['450f3f15-fe8c-4137-981c-9d1f8cf4a402', '069f2ff2-3f0e-456e-a1e7-b397c2028934', 'e2162a78-1bbf-46dc-8881-bc39bca4679e', 'b73c6ec2-6f0d-470d-b67f-a8ad571e97ba'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:20:47 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e Jul 14 21:20:47 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:47 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:20:47 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:47 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e" returned: 0 in 0.380s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Creating direct copy from snapshot {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf9b9f1-f5c1-4802-a282-d38159cdc757]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:47 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.268s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:20:47 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-8777a41c-5725-4d87-a739-3f505c70aea4 tempest-GroupSnapshotsTest-1411126106 None] Delete group completed successfully. Jul 14 21:20:47 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] group_snapshot 63746c0b-8ffa-4911-832e-09f072752300: deleting Jul 14 21:20:47 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 Jul 14 21:20:47 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] group_snapshot 63746c0b-8ffa-4911-832e-09f072752300: deleting {{(pid=88300) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "cinder-quobyte-e44db337-78af-4563-bba7-053edc0f619f" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-e44db337-78af-4563-bba7-053edc0f619f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "cinder-quobyte-1e8cce75-08e4-430a-b869-fdac8cf601f0" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-1e8cce75-08e4-430a-b869-fdac8cf601f0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] Deleting offline snapshot 1e8cce75-08e4-430a-b869-fdac8cf601f0 of volume e44db337-78af-4563-bba7-053edc0f619f {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] snapshot_file for this snap is: volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fea5303-3762-4756-9863-d0dd4fddaf07]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:47 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0 Jul 14 21:20:47 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:48 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430" returned: 0 in 0.397s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:48 devstack cinder-volume[88300]: DEBUG cinder.utils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Path /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e not found in is_blk_device check {{(pid=88300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 21:20:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:48 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e Jul 14 21:20:48 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:48 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0" returned: 0 in 0.382s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e44db337-78af-4563-bba7-053edc0f619f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:20:48 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a86d48-7b7b-44b8-865b-deecb77674a0]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:48 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f Jul 14 21:20:48 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:48 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f" returned: 0 in 0.543s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:48 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0 Jul 14 21:20:48 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:49 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0" returned: 0 in 0.845s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:49 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0 Jul 14 21:20:49 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:50 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f.1e8cce75-08e4-430a-b869-fdac8cf601f0" returned: 0 in 0.517s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:50 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-1e8cce75-08e4-430a-b869-fdac8cf601f0" released by "_delete_snapshot" :: held 2.417s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:50 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-e44db337-78af-4563-bba7-053edc0f619f" released by "delete_snapshot" :: held 2.451s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:50 devstack cinder-volume[88300]: WARNING cinder.quota [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1217999563 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1217999563, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:20:50 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] Created reservations ['be5011b9-524b-4120-83f5-f27c19426fb8', '2e2cb45c-e5f0-4d95-9076-53d33774a1b7', '57f13205-48c6-4fd6-be95-9c1ac5d0025c', '9cd3170e-aee6-4033-a06e-170f5cb7c5a5'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:20:50 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-7332aab8-b7fb-4b6e-aceb-be4013f55916 tempest-GroupSnapshotsTest-1411126106 None] group_snapshot 63746c0b-8ffa-4911-832e-09f072752300: deleted successfully Jul 14 21:20:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "cinder-quobyte-e44db337-78af-4563-bba7-053edc0f619f" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-e44db337-78af-4563-bba7-053edc0f619f" acquired by "delete_volume" :: waited 0.032s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:52 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9fe229-827e-4c44-9bb5-ba819d82a89e]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:52 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f Jul 14 21:20:52 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:52 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e" returned: 0 in 4.606s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:52 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bea6a5-3824-4325-8535-d9e8f931c52d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:52 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 Jul 14 21:20:52 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:52 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f" returned: 0 in 0.616s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:52 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f Jul 14 21:20:52 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:53 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e44db337-78af-4563-bba7-053edc0f619f" returned: 0 in 0.239s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-e44db337-78af-4563-bba7-053edc0f619f" released by "delete_volume" :: held 0.980s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] Created reservations ['8ba30b51-e3a4-4f5a-9ea2-9a768c584116'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:20:53 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:53 devstack cinder-volume[88300]: WARNING cinder.db.api [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1217999563'] Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430" returned: 0 in 0.566s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Image conversion details: src /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430, size 1024.00 MB, duration 4.61 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:20:53 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Converted 1024.00 MB image at 222.27 MB/s Jul 14 21:20:53 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e is being set with open permissions: ugo+rw Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] Created reservations ['d1a876af-16ff-4cb5-b602-6dccdba1ad1b', 'fa62251c-d84d-4897-b1f2-ffacd8fc4d94', '1c7b9f4a-c2ef-40ea-8eed-af0f28b32dd8', '73312c76-a58c-47b4-a59f-f77f8db7e034'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:20:53 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e Jul 14 21:20:53 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:53 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:20:53 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:53 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e" returned: 0 in 0.239s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Lock "cinder-quobyte-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e" released by "_copy_volume_from_snapshot" :: held 6.271s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Acquiring lock "cinder-quobyte-c50c0a05-7e0c-454e-889d-7c652571a18e" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Lock "cinder-quobyte-c50c0a05-7e0c-454e-889d-7c652571a18e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Deleting offline snapshot c50c0a05-7e0c-454e-889d-7c652571a18e of volume f54743c8-c62a-4a8e-8af2-0ad61f3c3430 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] snapshot_file for this snap is: volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b9ed24-f1e7-47f3-91f9-9b5f3671dbcb]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:53 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.271s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:20:53 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f6297873-0a7e-4506-9549-d24b01574a0b tempest-GroupSnapshotsTest-1411126106 None] Delete group completed successfully. Jul 14 21:20:53 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e Jul 14 21:20:53 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:53 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-c6edea93-1d4b-4377-b5bf-03e14b40279e tempest-GroupSnapshotsTest-1411126106 None] Group tempest-GroupSnapshotsTest-Group-1244365805: creating Jul 14 21:20:53 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-c6edea93-1d4b-4377-b5bf-03e14b40279e tempest-GroupSnapshotsTest-1411126106 None] Group tempest-GroupSnapshotsTest-Group-1244365805: created successfully Jul 14 21:20:53 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-c6edea93-1d4b-4377-b5bf-03e14b40279e tempest-GroupSnapshotsTest-1411126106 None] Create group completed successfully. Jul 14 21:20:53 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e" returned: 0 in 0.382s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[135acdc9-f5f3-4457-8cf8-005be70e54eb]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:54 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 Jul 14 21:20:54 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:54 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430" returned: 0 in 0.346s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:54 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e Jul 14 21:20:54 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:54 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e" returned: 0 in 0.323s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:54 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e Jul 14 21:20:54 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:54 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430.c50c0a05-7e0c-454e-889d-7c652571a18e" returned: 0 in 0.244s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Lock "cinder-quobyte-c50c0a05-7e0c-454e-889d-7c652571a18e" released by "_delete_snapshot" :: held 1.400s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.686s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.698s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-188300497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fa78fe-f545-4fdc-9a94-ed0c52b050db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0cb0919e7974bfe96e8c1bfdccd236d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:20:40Z,use_quota=True,user_id='fb50fc4e9c0c41969d978cf2b227c1e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Creating volume f6fa78fe-f545-4fdc-9a94-ed0c52b050db {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:20:54 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f6fa78fe-f545-4fdc-9a94-ed0c52b050db 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbaeaa5f-cc9c-4c20-9259-c965873e6c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e', 'volume_size': 2, 'source_volid': 'f54743c8-c62a-4a8e-8af2-0ad61f3c3430', 'source_volstatus': 'available'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:54 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f6fa78fe-f545-4fdc-9a94-ed0c52b050db 1073741824 Jul 14 21:20:54 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa2fd70-a420-4b57-bb8f-3c6492cedcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:54 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Volume volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e (aa4fdc7b-1983-42ba-91dd-9b32bc69c26e): created successfully Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa2fd70-a420-4b57-bb8f-3c6492cedcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Flow 'volume_create_manager' (d4cb9e2f-38dd-4e74-a307-ee9632c6f0fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:20:55 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2d59fd4c-9457-477f-8142-d38e90f7b911 tempest-VolumesCloneTest-1429569658 None] Created volume successfully. Jul 14 21:20:55 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f6fa78fe-f545-4fdc-9a94-ed0c52b050db 1073741824" returned: 0 in 0.464s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Flow 'volume_create_manager' (472381fb-2afc-475a-a6b0-d49c96fbfdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dffba6e-3c89-4e45-99a8-9a2471dbf7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dffba6e-3c89-4e45-99a8-9a2471dbf7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-247333120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54687e1f-eb6a-4a75-981f-7af2e2865bde,host='devstack@QuobyteHD#QuobyteHD',id=6eb41f64-739c-48bc-8cc0-a39dc68982ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7876f2336b3043df91787bc89606eb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:20:55Z,use_quota=True,user_id='0835bc9470b341c993668ed0e1f0d8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec193f2e-878e-44da-a16c-177de39615b6),volume_type_id=ec193f2e-878e-44da-a16c-177de39615b6)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351c9c2e-a602-4529-8a67-628431e33949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351c9c2e-a602-4529-8a67-628431e33949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74e20ab-f254-4b83-ac8e-688bfc035b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74e20ab-f254-4b83-ac8e-688bfc035b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eb41f64-739c-48bc-8cc0-a39dc68982ca', 'volume_name': 'volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f096731-bcdd-4d14-b66a-7ac181cf919a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f096731-bcdd-4d14-b66a-7ac181cf919a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23b51ea-9bb8-41de-bbf4-5bb20326ceb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:55 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Volume 6eb41f64-739c-48bc-8cc0-a39dc68982ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca', 'volume_size': 1} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f6fa78fe-f545-4fdc-9a94-ed0c52b050db {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:55 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f6fa78fe-f545-4fdc-9a94-ed0c52b050db Jul 14 21:20:55 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] Acquiring lock "cinder-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:55 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] Lock "cinder-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f6fa78fe-f545-4fdc-9a94-ed0c52b050db" returned: 0 in 0.253s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-831a22d6-3a6e-40e6-88f0-da0279f089e4 req-3bb7ed03-f75d-4748-9857-782381c13322 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.222s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31db95b0-f4f9-4be0-a5f0-8e638672543c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6fa78fe-f545-4fdc-9a94-ed0c52b050db', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e22c3b-3410-4b2a-9849-af029c6a650d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a71b14-5b9a-49f3-b9e8-387899b80b6a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-831a22d6-3a6e-40e6-88f0-da0279f089e4 req-3bb7ed03-f75d-4748-9857-782381c13322 tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b6eeae0d-d0e1-4d36-abbe-54d778445177 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:55 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Volume volume-f6fa78fe-f545-4fdc-9a94-ed0c52b050db (f6fa78fe-f545-4fdc-9a94-ed0c52b050db): created successfully Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e22c3b-3410-4b2a-9849-af029c6a650d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Flow 'volume_create_manager' (3d4f748a-9051-4881-b03f-773762fdb8c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] Acquiring lock "cinder-quobyte-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:55 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-124dec77-13c5-4674-8e75-447f410a312f tempest-VolumesServicesTestJSON-1754491206 None] Created volume successfully. Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] Lock "cinder-quobyte-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e" acquired by "delete_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19a6b82-d9b2-4357-8924-c58a43a9b062]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:55 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b6eeae0d-d0e1-4d36-abbe-54d778445177 Jul 14 21:20:55 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:56 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e Jul 14 21:20:56 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:56 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-831a22d6-3a6e-40e6-88f0-da0279f089e4 req-3bb7ed03-f75d-4748-9857-782381c13322 tempest-AttachVolumeNegativeTest-850271826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b6eeae0d-d0e1-4d36-abbe-54d778445177" returned: 0 in 0.379s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-831a22d6-3a6e-40e6-88f0-da0279f089e4 req-3bb7ed03-f75d-4748-9857-782381c13322 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.407s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.672s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=54687e1f-eb6a-4a75-981f-7af2e2865bde,created_at=2026-07-14T19:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-247333120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54687e1f-eb6a-4a75-981f-7af2e2865bde,host='devstack@QuobyteHD#QuobyteHD',id=6eb41f64-739c-48bc-8cc0-a39dc68982ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7876f2336b3043df91787bc89606eb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:20:55Z,use_quota=True,user_id='0835bc9470b341c993668ed0e1f0d8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec193f2e-878e-44da-a16c-177de39615b6),volume_type_id=ec193f2e-878e-44da-a16c-177de39615b6)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Creating volume 6eb41f64-739c-48bc-8cc0-a39dc68982ca {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:20:56 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:56 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca 1073741824 Jul 14 21:20:56 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-831a22d6-3a6e-40e6-88f0-da0279f089e4 req-3bb7ed03-f75d-4748-9857-782381c13322 tempest-AttachVolumeNegativeTest-850271826 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-b6eeae0d-d0e1-4d36-abbe-54d778445177', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '228dfd11-0b62-490c-a088-a1d2f8ed9b8d', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:20:56 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e" returned: 0 in 0.384s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:56 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e Jul 14 21:20:56 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:56 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-831a22d6-3a6e-40e6-88f0-da0279f089e4 req-3bb7ed03-f75d-4748-9857-782381c13322 tempest-AttachVolumeNegativeTest-850271826 None] attachment_update completed successfully. Jul 14 21:20:56 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e" returned: 0 in 0.359s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] Lock "cinder-quobyte-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e" released by "delete_volume" :: held 0.795s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] Created reservations ['d615bda6-6a3b-4686-93ad-c7c1567e5d7c', 'e2d9ca17-5132-40f8-89c8-86649ee8b5e3', '1ca3edf7-5e6e-4e65-b990-eb85dc758688', '12058841-fbf2-4657-8c5c-fa4ed9999d5d'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:20:56 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] Acquiring lock "cinder-f6fa78fe-f545-4fdc-9a94-ed0c52b050db-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca 1073741824" returned: 0 in 0.604s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] Lock "cinder-f6fa78fe-f545-4fdc-9a94-ed0c52b050db-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:56 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca Jul 14 21:20:56 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] Acquiring lock "cinder-f54743c8-c62a-4a8e-8af2-0ad61f3c3430-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:57 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:20:57 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] Acquiring lock "cinder-quobyte-f6fa78fe-f545-4fdc-9a94-ed0c52b050db" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] Lock "cinder-f54743c8-c62a-4a8e-8af2-0ad61f3c3430-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] Lock "cinder-quobyte-f6fa78fe-f545-4fdc-9a94-ed0c52b050db" acquired by "delete_volume" :: waited 0.045s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d66527-da45-44cc-96e9-895415490783]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f6fa78fe-f545-4fdc-9a94-ed0c52b050db {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] Acquiring lock "cinder-quobyte-f54743c8-c62a-4a8e-8af2-0ad61f3c3430" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] Lock "cinder-quobyte-f54743c8-c62a-4a8e-8af2-0ad61f3c3430" acquired by "delete_volume" :: waited 0.036s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[db50e758-f857-47c2-b98e-84bf271403bd]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:57 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f6fa78fe-f545-4fdc-9a94-ed0c52b050db Jul 14 21:20:57 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:57 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca" returned: 0 in 0.385s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23b51ea-9bb8-41de-bbf4-5bb20326ceb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f6d7cb-9d57-4b1b-a86e-badb8b2a0a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:57 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:57 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Volume volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca (6eb41f64-739c-48bc-8cc0-a39dc68982ca): created successfully Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f6d7cb-9d57-4b1b-a86e-badb8b2a0a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Flow 'volume_create_manager' (472381fb-2afc-475a-a6b0-d49c96fbfdf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.393s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:20:57 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] Deleted volume successfully. Jul 14 21:20:57 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-cde17267-00fd-49a0-8bda-7ca05cecf9e4 tempest-GroupSnapshotsTest-1411126106 None] Created volume successfully. Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db6da6ba-a13e-49d3-82a1-d62350b38d01 tempest-VolumesCloneTest-1429569658 None] Lock "cinder-aa4fdc7b-1983-42ba-91dd-9b32bc69c26e-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:57 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 Jul 14 21:20:57 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:57 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f6fa78fe-f545-4fdc-9a94-ed0c52b050db" returned: 0 in 0.462s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f6fa78fe-f545-4fdc-9a94-ed0c52b050db {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:57 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f6fa78fe-f545-4fdc-9a94-ed0c52b050db Jul 14 21:20:57 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:57 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430" returned: 0 in 0.440s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:57 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430 Jul 14 21:20:57 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:57 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f6fa78fe-f545-4fdc-9a94-ed0c52b050db" returned: 0 in 0.277s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] Lock "cinder-quobyte-f6fa78fe-f545-4fdc-9a94-ed0c52b050db" released by "delete_volume" :: held 0.805s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] Created reservations ['84740214-d72a-4193-953f-d07822c4c2e5', 'f5adfc15-c6ec-4b28-99f9-2afeae6b7954', 'd766fa8e-e3ac-4e8c-8780-8e475ab1c69e', '7b0f8efb-49cf-452b-a8ee-e5581931f23a'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:20:58 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f54743c8-c62a-4a8e-8af2-0ad61f3c3430" returned: 0 in 0.350s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] Lock "cinder-quobyte-f54743c8-c62a-4a8e-8af2-0ad61f3c3430" released by "delete_volume" :: held 0.895s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:58 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:20:58 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] Created reservations ['e5fd8a74-ce66-4681-bf21-ecf731326cf1', '3dd9780e-f64a-480a-9d7d-12f6655a6617', 'e212d00d-db0d-45bf-8205-58fa0dd1e042', 'f1cf3da0-56f4-4f46-851c-ad92129a9a4a'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:58 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:20:58 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:58 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.306s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:20:58 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] Deleted volume successfully. Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-75bf277e-9db1-45d0-8fac-5fb73060448b tempest-VolumesServicesTestJSON-1754491206 None] Lock "cinder-f6fa78fe-f545-4fdc-9a94-ed0c52b050db-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:58 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.315s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:20:58 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] Deleted volume successfully. Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2646f18c-0300-47df-a7fd-75cc955d645a tempest-VolumesCloneTest-1429569658 None] Lock "cinder-f54743c8-c62a-4a8e-8af2-0ad61f3c3430-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Flow 'volume_create_manager' (c656236d-5047-4df0-9372-b89bd0a64645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77eb36a7-3b8a-41a8-b5e3-457b54cd86a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77eb36a7-3b8a-41a8-b5e3-457b54cd86a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-529338898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54687e1f-eb6a-4a75-981f-7af2e2865bde,host='devstack@QuobyteHD#QuobyteHD',id=6304a9cc-44d0-4afc-9198-7507ed93da22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7876f2336b3043df91787bc89606eb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:20:59Z,use_quota=True,user_id='0835bc9470b341c993668ed0e1f0d8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec193f2e-878e-44da-a16c-177de39615b6),volume_type_id=ec193f2e-878e-44da-a16c-177de39615b6)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c627ce-34b5-4be5-abdd-b5a396356d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c627ce-34b5-4be5-abdd-b5a396356d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58295cd9-e83b-47e0-8deb-31dd878a17bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58295cd9-e83b-47e0-8deb-31dd878a17bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6304a9cc-44d0-4afc-9198-7507ed93da22', 'volume_name': 'volume-6304a9cc-44d0-4afc-9198-7507ed93da22', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70575b5-99ea-4f95-b190-81e64156c93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70575b5-99ea-4f95-b190-81e64156c93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caaff28a-3186-419f-ae1b-573afd311474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:58 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Volume 6304a9cc-44d0-4afc-9198-7507ed93da22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6304a9cc-44d0-4afc-9198-7507ed93da22', 'volume_size': 1} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=54687e1f-eb6a-4a75-981f-7af2e2865bde,created_at=2026-07-14T19:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-529338898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54687e1f-eb6a-4a75-981f-7af2e2865bde,host='devstack@QuobyteHD#QuobyteHD',id=6304a9cc-44d0-4afc-9198-7507ed93da22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7876f2336b3043df91787bc89606eb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:20:59Z,use_quota=True,user_id='0835bc9470b341c993668ed0e1f0d8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec193f2e-878e-44da-a16c-177de39615b6),volume_type_id=ec193f2e-878e-44da-a16c-177de39615b6)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Creating volume 6304a9cc-44d0-4afc-9198-7507ed93da22 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:20:58 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:20:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:58 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22 1073741824 Jul 14 21:20:58 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:59 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22 1073741824" returned: 0 in 0.552s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:20:59 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22 Jul 14 21:20:59 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:20:59 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Jul 14 21:20:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22" returned: 0 in 0.299s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:20:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:20:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:20:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caaff28a-3186-419f-ae1b-573afd311474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6304a9cc-44d0-4afc-9198-7507ed93da22', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21062420-599a-426c-86e8-f543cf773095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:20:59 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Volume volume-6304a9cc-44d0-4afc-9198-7507ed93da22 (6304a9cc-44d0-4afc-9198-7507ed93da22): created successfully Jul 14 21:20:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21062420-599a-426c-86e8-f543cf773095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:20:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Flow 'volume_create_manager' (c656236d-5047-4df0-9372-b89bd0a64645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:20:59 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-b5c9bc8f-4e07-4ef0-be34-6f08e078fdec tempest-GroupSnapshotsTest-1411126106 None] Created volume successfully. Jul 14 21:21:00 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-afe02ee3-f568-4a43-8b54-b74a97295e93 tempest-GroupSnapshotsTest-1411126106 None] Update group completed successfully. Jul 14 21:21:01 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-389c1492-95d9-467f-b616-0a4fe83ad227 tempest-GroupSnapshotsTest-1411126106 None] Update group completed successfully. Jul 14 21:21:02 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0a76274d-e341-43af-b01c-78d79a465f74 tempest-GroupSnapshotsTest-1411126106 None] Update group completed successfully. Jul 14 21:21:04 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d74ae629-e36f-4541-9b77-7d21d623a6f2 tempest-GroupSnapshotsTest-1411126106 None] Update group completed successfully. Jul 14 21:21:05 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] GroupSnapshot 1e32b063-839b-4fe2-a962-50f7f66731db: creating. Jul 14 21:21:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Group snapshot 1e32b063-839b-4fe2-a962-50f7f66731db: creating. {{(pid=88300) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 14 21:21:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Creating offline snapshot 0ebc9d87-c8b6-4370-8acb-627d872be94c of volume 6eb41f64-739c-48bc-8cc0-a39dc68982ca {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:21:05 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14c2e3b-519a-4950-96b8-a7ac9332ad31]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:05 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca Jul 14 21:21:05 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:06 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca" returned: 0 in 0.407s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:06 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c 1G Jul 14 21:21:06 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:06 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c 1G" returned: 0 in 0.506s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:06 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c Jul 14 21:21:06 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:06 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c" returned: 0 in 0.364s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:06 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c is being set with open permissions: ugo+rw: NotImplementedError Jul 14 21:21:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:07 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c Jul 14 21:21:07 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:07 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c" returned: 0 in 0.306s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:07 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.info Jul 14 21:21:07 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:07 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.info" returned: 0 in 0.332s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:07 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 21:21:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:07 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.info Jul 14 21:21:07 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:07 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.info" returned: 0 in 0.298s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.318s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Creating offline snapshot b6f825e9-7bb9-4a6a-9d8c-721452cec632 of volume 6304a9cc-44d0-4afc-9198-7507ed93da22 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:21:08 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7aa416-4c51-4331-b2f8-497fd58a602e]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:08 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22 Jul 14 21:21:08 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:08 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22" returned: 0 in 0.392s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:08 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632 1G Jul 14 21:21:08 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:08 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632 1G" returned: 0 in 0.486s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6304a9cc-44d0-4afc-9198-7507ed93da22 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:08 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6304a9cc-44d0-4afc-9198-7507ed93da22 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632 Jul 14 21:21:08 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:09 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6304a9cc-44d0-4afc-9198-7507ed93da22 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632" returned: 0 in 0.408s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:09 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632 is being set with open permissions: ugo+rw: NotImplementedError Jul 14 21:21:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:09 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632 Jul 14 21:21:09 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:09 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632" returned: 0 in 0.321s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:09 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=113,cinder:UPDATE=126,cinder:INSERT=25,cinder:DELETE=5 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:21:09 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=119,cinder:UPDATE=118,cinder:DELETE=9,cinder:INSERT=32 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:21:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:09 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.info Jul 14 21:21:09 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:09 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.info" returned: 0 in 0.284s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:09 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 21:21:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:09 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.info Jul 14 21:21:10 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:10 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.info" returned: 0 in 0.289s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.296s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:10 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-fa37f705-3c6b-45bf-97d1-178982be6cca tempest-GroupSnapshotsTest-1411126106 None] group_snapshot 1e32b063-839b-4fe2-a962-50f7f66731db: created successfully Jul 14 21:21:11 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] group_snapshot 1e32b063-839b-4fe2-a962-50f7f66731db: deleting Jul 14 21:21:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] group_snapshot 1e32b063-839b-4fe2-a962-50f7f66731db: deleting {{(pid=88300) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 14 21:21:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "cinder-quobyte-6eb41f64-739c-48bc-8cc0-a39dc68982ca" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-6eb41f64-739c-48bc-8cc0-a39dc68982ca" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "cinder-quobyte-0ebc9d87-c8b6-4370-8acb-627d872be94c" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-0ebc9d87-c8b6-4370-8acb-627d872be94c" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Deleting offline snapshot 0ebc9d87-c8b6-4370-8acb-627d872be94c of volume 6eb41f64-739c-48bc-8cc0-a39dc68982ca {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:21:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] snapshot_file for this snap is: volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:21:11 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efe849d-6d1c-4587-83b1-d84b4dbf8b9e]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:11 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c Jul 14 21:21:11 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:11 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c" returned: 0 in 0.544s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:21:11 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1bc7ea-602b-41a7-bb41-ace62eedaa28]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:12 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca Jul 14 21:21:12 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:12 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca" returned: 0 in 0.425s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:12 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c Jul 14 21:21:12 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:12 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c" returned: 0 in 0.439s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:12 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c Jul 14 21:21:12 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:13 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca.0ebc9d87-c8b6-4370-8acb-627d872be94c" returned: 0 in 0.285s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-0ebc9d87-c8b6-4370-8acb-627d872be94c" released by "_delete_snapshot" :: held 1.851s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-6eb41f64-739c-48bc-8cc0-a39dc68982ca" released by "delete_snapshot" :: held 1.893s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "cinder-quobyte-6304a9cc-44d0-4afc-9198-7507ed93da22" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-6304a9cc-44d0-4afc-9198-7507ed93da22" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "cinder-quobyte-b6f825e9-7bb9-4a6a-9d8c-721452cec632" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-b6f825e9-7bb9-4a6a-9d8c-721452cec632" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:13 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Deleting offline snapshot b6f825e9-7bb9-4a6a-9d8c-721452cec632 of volume 6304a9cc-44d0-4afc-9198-7507ed93da22 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:21:13 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] snapshot_file for this snap is: volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:21:13 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df522b9-d689-4166-b721-8156e9f5fff4]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:13 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632 Jul 14 21:21:13 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:13 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632" returned: 0 in 0.424s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:13 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6304a9cc-44d0-4afc-9198-7507ed93da22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:21:13 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f71b37-2bb3-4c98-b09f-bb4cc8237732]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:13 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22 Jul 14 21:21:13 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:14 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22" returned: 0 in 0.396s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:14 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632 Jul 14 21:21:14 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:14 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632" returned: 0 in 0.416s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:14 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632 Jul 14 21:21:14 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:14 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22.b6f825e9-7bb9-4a6a-9d8c-721452cec632" returned: 0 in 0.288s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-b6f825e9-7bb9-4a6a-9d8c-721452cec632" released by "_delete_snapshot" :: held 1.670s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-6304a9cc-44d0-4afc-9198-7507ed93da22" released by "delete_snapshot" :: held 1.699s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:14 devstack cinder-volume[88300]: WARNING cinder.quota [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1307713069 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1307713069, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:21:14 devstack cinder-volume[88300]: WARNING cinder.quota [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1307713069 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1307713069, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:21:14 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Created reservations ['9945825b-4dbf-4dcb-8d56-94b585fe2b68', '0562df31-04cf-4ff8-9c8f-c56fc04d1460', '4b11ce34-40a0-4b19-8a00-136a18d4f120', 'c58dcefc-2274-4b83-bb1d-9683f73f3c16'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:21:15 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] Created reservations ['2613860f-9e96-44f8-88da-2222e8c00ba2', '8d35a098-e2e7-4437-86eb-23850ed0a6c7', 'bea21777-a4b9-4740-88ca-c295f2cd29a0', '03f5052c-b713-48c1-97ba-4e86cba07e9b'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:21:15 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-692047d3-634c-4343-8fda-6c583a2786ba tempest-GroupSnapshotsTest-1411126106 None] group_snapshot 1e32b063-839b-4fe2-a962-50f7f66731db: deleted successfully Jul 14 21:21:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "cinder-quobyte-6304a9cc-44d0-4afc-9198-7507ed93da22" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-6304a9cc-44d0-4afc-9198-7507ed93da22" acquired by "delete_volume" :: waited 0.037s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:16 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ee0a65-af5b-4090-8d58-a5c3f57507da]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:16 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22 Jul 14 21:21:16 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:16 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:21:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Flow 'volume_create_manager' (71ae555a-32df-4180-8149-149a5cc47584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:21:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231f7d87-d12f-4422-899a-901f58287197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231f7d87-d12f-4422-899a-901f58287197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1208990263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe93ffe-ab05-4c1f-b230-2f95fdf5976c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648c85637b4e4c04a6c69d24d7ab2963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:21:17Z,use_quota=True,user_id='53e43d748eb14cc1b1b1e6df46403c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d89a22-0f91-4363-957b-6764d8cb7a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d89a22-0f91-4363-957b-6764d8cb7a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0459aca-b371-48ff-ade3-1967f4400f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0459aca-b371-48ff-ade3-1967f4400f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fe93ffe-ab05-4c1f-b230-2f95fdf5976c', 'volume_name': 'volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9decd0f1-a0ea-4286-9d04-67f45591e16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9decd0f1-a0ea-4286-9d04-67f45591e16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa43397-14c6-4c3f-a393-d0e34e649dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:17 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Volume 5fe93ffe-ab05-4c1f-b230-2f95fdf5976c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c', 'volume_size': 1} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1208990263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe93ffe-ab05-4c1f-b230-2f95fdf5976c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648c85637b4e4c04a6c69d24d7ab2963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:21:17Z,use_quota=True,user_id='53e43d748eb14cc1b1b1e6df46403c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Creating volume 5fe93ffe-ab05-4c1f-b230-2f95fdf5976c {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:21:17 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:17 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c 1073741824 Jul 14 21:21:17 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:17 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22" returned: 0 in 1.011s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:17 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22 Jul 14 21:21:17 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:17 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c 1073741824" returned: 0 in 0.857s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:18 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c Jul 14 21:21:18 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:18 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6304a9cc-44d0-4afc-9198-7507ed93da22" returned: 0 in 0.593s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-6304a9cc-44d0-4afc-9198-7507ed93da22" released by "delete_volume" :: held 1.805s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "cinder-quobyte-6eb41f64-739c-48bc-8cc0-a39dc68982ca" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-6eb41f64-739c-48bc-8cc0-a39dc68982ca" acquired by "delete_volume" :: waited 0.039s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:18 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[377f9430-3d24-487a-9768-66a2ed1ee3fb]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:18 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c" returned: 0 in 0.404s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:21:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa43397-14c6-4c3f-a393-d0e34e649dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad3125d-ef66-4ea0-9534-93a8c83bdb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:18 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Volume volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c (5fe93ffe-ab05-4c1f-b230-2f95fdf5976c): created successfully Jul 14 21:21:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad3125d-ef66-4ea0-9534-93a8c83bdb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Flow 'volume_create_manager' (71ae555a-32df-4180-8149-149a5cc47584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:21:18 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-c4ca5ecc-b30d-4aad-8011-3538e57164a4 tempest-VolumesSnapshotTestJSON-999933281 None] Created volume successfully. Jul 14 21:21:18 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca Jul 14 21:21:18 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:19 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca" returned: 0 in 0.741s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:19 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca Jul 14 21:21:19 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:19 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6eb41f64-739c-48bc-8cc0-a39dc68982ca" returned: 0 in 0.554s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-6eb41f64-739c-48bc-8cc0-a39dc68982ca" released by "delete_volume" :: held 1.392s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:19 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Created reservations ['998ff5fc-4a26-4be5-a378-de555bff1148'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:21:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] Creating offline snapshot d8b31439-22d6-4615-b7fa-976bf817c191 of volume 5fe93ffe-ab05-4c1f-b230-2f95fdf5976c {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:21:19 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca8244d-80b6-4818-a83c-98528e24d7ed]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:19 devstack cinder-volume[88300]: WARNING cinder.quota [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1307713069 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1307713069, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:21:20 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Created reservations ['c6cee270-f0a9-4037-a165-657b7439ef4b', '5b0c976e-cbc5-41dd-bdcb-36dc59f73adf', '9b3d5934-c28d-41e9-bfeb-a07ef89eb849', '3fa35079-f455-4aae-85bc-30b14ccd8fb6'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:21:20 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c Jul 14 21:21:20 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:20 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Created reservations ['6eafc209-b468-43ce-8580-b7ba76361cfd', '4b9c235b-6c2d-4ce3-9cc3-5e1ebe1d65bd', '2165408c-6f01-494e-acd0-d60579fe94c2', '220e9f47-a235-4c9c-bef6-a37bc4a770c5'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:21:20 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c" returned: 0 in 0.607s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:20 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191 1G Jul 14 21:21:20 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:21:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:21:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:20 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:21:20 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:21 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.614s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:21 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:21:21 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191 1G" returned: 0 in 0.732s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:21 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-6c1e9a2f-9bde-49fe-9a23-2e6e132911a7 tempest-GroupSnapshotsTest-1411126106 None] Delete group completed successfully. Jul 14 21:21:21 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191 Jul 14 21:21:21 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:21 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f810b519-db7b-49d0-90ce-0a2c4b96c627 tempest-GroupSnapshotsTest-1411126106 None] Group tempest-GroupSnapshotsTest-Group-1896831668: creating Jul 14 21:21:21 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f810b519-db7b-49d0-90ce-0a2c4b96c627 tempest-GroupSnapshotsTest-1411126106 None] Group tempest-GroupSnapshotsTest-Group-1896831668: created successfully Jul 14 21:21:21 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f810b519-db7b-49d0-90ce-0a2c4b96c627 tempest-GroupSnapshotsTest-1411126106 None] Create group completed successfully. Jul 14 21:21:21 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191" returned: 0 in 0.488s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:21 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191 is being set with open permissions: ugo+rw Jul 14 21:21:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:21 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191 Jul 14 21:21:21 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:22 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191" returned: 0 in 0.374s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:22 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.info Jul 14 21:21:22 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:22 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.info" returned: 0 in 0.338s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:22 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.info is being set with open permissions: ugo+rw Jul 14 21:21:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:22 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.info Jul 14 21:21:22 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:22 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.info" returned: 0 in 0.449s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.134s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:23 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-5e4d2b30-0b7d-435a-848f-a50867ffebfa tempest-VolumesSnapshotTestJSON-999933281 None] Create snapshot completed successfully Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Flow 'volume_create_manager' (dfe82670-aa4c-4aef-9cf5-b4b2755d9751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb864e3-3b46-44e7-b581-ef28aa359c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb864e3-3b46-44e7-b581-ef28aa359c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-182998545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0711aec-a310-4151-86bf-ff68ae378b03,host='devstack@QuobyteHD#QuobyteHD',id=016201cc-8947-4592-b61e-1666a60314b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7876f2336b3043df91787bc89606eb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:21:23Z,use_quota=True,user_id='0835bc9470b341c993668ed0e1f0d8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fc60c52-b132-48d3-b8bb-4a000299e516),volume_type_id=3fc60c52-b132-48d3-b8bb-4a000299e516)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6e044c-cc19-4523-bb2b-89acbd12cd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6e044c-cc19-4523-bb2b-89acbd12cd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621a8d9c-7f6a-4486-b9f3-0f5957bfb34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621a8d9c-7f6a-4486-b9f3-0f5957bfb34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '016201cc-8947-4592-b61e-1666a60314b2', 'volume_name': 'volume-016201cc-8947-4592-b61e-1666a60314b2', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a3a3ff-5c55-4607-a0a3-1dedbd069c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a3a3ff-5c55-4607-a0a3-1dedbd069c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc3bba7-3bb5-4bd9-bf0f-70d31344247c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:23 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Volume 016201cc-8947-4592-b61e-1666a60314b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-016201cc-8947-4592-b61e-1666a60314b2', 'volume_size': 1} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c0711aec-a310-4151-86bf-ff68ae378b03,created_at=2026-07-14T19:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-182998545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0711aec-a310-4151-86bf-ff68ae378b03,host='devstack@QuobyteHD#QuobyteHD',id=016201cc-8947-4592-b61e-1666a60314b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7876f2336b3043df91787bc89606eb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:21:23Z,use_quota=True,user_id='0835bc9470b341c993668ed0e1f0d8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fc60c52-b132-48d3-b8bb-4a000299e516),volume_type_id=3fc60c52-b132-48d3-b8bb-4a000299e516)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Creating volume 016201cc-8947-4592-b61e-1666a60314b2 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:21:23 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:21:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:23 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2 1073741824 Jul 14 21:21:23 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:24 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2 1073741824" returned: 0 in 0.693s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:24 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2 Jul 14 21:21:24 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-d8b31439-22d6-4615-b7fa-976bf817c191-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-d8b31439-22d6-4615-b7fa-976bf817c191-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-quobyte-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-quobyte-d8b31439-22d6-4615-b7fa-976bf817c191" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-d8b31439-22d6-4615-b7fa-976bf817c191" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] Deleting offline snapshot d8b31439-22d6-4615-b7fa-976bf817c191 of volume 5fe93ffe-ab05-4c1f-b230-2f95fdf5976c {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:21:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] snapshot_file for this snap is: volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:21:24 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8755e1-b577-4a1b-92b1-e8c9f5b76181]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:24 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2" returned: 0 in 0.448s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:21:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc3bba7-3bb5-4bd9-bf0f-70d31344247c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-016201cc-8947-4592-b61e-1666a60314b2', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd11487e-5205-4a03-8e08-1e2981b018c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:25 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Volume volume-016201cc-8947-4592-b61e-1666a60314b2 (016201cc-8947-4592-b61e-1666a60314b2): created successfully Jul 14 21:21:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd11487e-5205-4a03-8e08-1e2981b018c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Flow 'volume_create_manager' (dfe82670-aa4c-4aef-9cf5-b4b2755d9751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:21:25 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-70205568-2690-46fe-b782-7a598d50ad4c tempest-GroupSnapshotsTest-1411126106 None] Created volume successfully. Jul 14 21:21:25 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191 Jul 14 21:21:25 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:25 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191" returned: 0 in 0.693s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:21:25 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acbc444-a9af-4fb4-b460-4ef7f1f461c8]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:25 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c Jul 14 21:21:25 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:26 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c" returned: 0 in 0.713s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:26 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191 Jul 14 21:21:26 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:26 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] GroupSnapshot e93c2e9b-fc06-401e-8870-07cba7df2f15: creating. Jul 14 21:21:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] Group snapshot e93c2e9b-fc06-401e-8870-07cba7df2f15: creating. {{(pid=88300) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 14 21:21:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:26 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] Creating offline snapshot a8ff851b-768a-4c40-a504-82028f9a1caa of volume 016201cc-8947-4592-b61e-1666a60314b2 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:21:27 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e3b411-601b-4849-a983-eaad6640b415]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:27 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191" returned: 0 in 0.704s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:27 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191 Jul 14 21:21:27 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:27 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2 Jul 14 21:21:27 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:27 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2" returned: 0 in 0.515s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:27 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c.d8b31439-22d6-4615-b7fa-976bf817c191" returned: 0 in 0.519s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:27 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa 1G Jul 14 21:21:27 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-d8b31439-22d6-4615-b7fa-976bf817c191" released by "_delete_snapshot" :: held 2.840s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c" released by "delete_snapshot" :: held 2.885s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:27 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] Created reservations ['06038970-1d8f-4ff9-9a6f-61bf45683ccf', '3cea557b-fa39-49cd-993a-118f9ef31584', '148f2219-dab3-469e-86eb-e431812e79a5', 'b8604500-6f44-478b-a470-4460e3276a3a'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:21:27 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] Delete snapshot completed successfully. Jul 14 21:21:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dbf96608-a738-4462-8acb-daa22955d5b4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-d8b31439-22d6-4615-b7fa-976bf817c191-delete_snapshot" released by "delete_snapshot" :: held 3.209s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:28 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa 1G" returned: 0 in 0.858s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-016201cc-8947-4592-b61e-1666a60314b2 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:28 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-016201cc-8947-4592-b61e-1666a60314b2 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa Jul 14 21:21:28 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:28 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:21:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Flow 'volume_create_manager' (65d6bb5e-9531-44df-9640-2996b428f5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:21:28 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a635402-9c14-46b8-b558-4f1645954b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-016201cc-8947-4592-b61e-1666a60314b2 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa" returned: 0 in 0.514s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:28 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa is being set with open permissions: ugo+rw: NotImplementedError Jul 14 21:21:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a635402-9c14-46b8-b558-4f1645954b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2039684362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76ba59d-18db-411f-9afb-4abb0cbe6ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648c85637b4e4c04a6c69d24d7ab2963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:21:29Z,use_quota=True,user_id='53e43d748eb14cc1b1b1e6df46403c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:28 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa Jul 14 21:21:28 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23dd2cc9-1747-4083-8640-ae473638229a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23dd2cc9-1747-4083-8640-ae473638229a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af7517b-23f4-4153-b5ee-24d2c6942de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af7517b-23f4-4153-b5ee-24d2c6942de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b76ba59d-18db-411f-9afb-4abb0cbe6ded', 'volume_name': 'volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778b23af-3d7f-4f76-aaa2-c515aa4bdbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778b23af-3d7f-4f76-aaa2-c515aa4bdbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b7b48e-6e50-4ca6-a407-b4b04ad68a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:29 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Volume b76ba59d-18db-411f-9afb-4abb0cbe6ded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded', 'volume_size': 1} Jul 14 21:21:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:29 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa" returned: 0 in 0.578s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:29 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.info Jul 14 21:21:29 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:29 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.info" returned: 0 in 0.398s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:29 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 14 21:21:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:29 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.info Jul 14 21:21:29 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:30 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.info" returned: 0 in 0.317s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.295s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.146s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2039684362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76ba59d-18db-411f-9afb-4abb0cbe6ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648c85637b4e4c04a6c69d24d7ab2963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:21:29Z,use_quota=True,user_id='53e43d748eb14cc1b1b1e6df46403c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:21:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Creating volume b76ba59d-18db-411f-9afb-4abb0cbe6ded {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:21:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:21:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:21:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:21:30 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:21:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:30 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded 1073741824 Jul 14 21:21:30 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:30 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-db975314-e2fb-4731-8466-f7aca0a9ea2e tempest-GroupSnapshotsTest-1411126106 None] group_snapshot e93c2e9b-fc06-401e-8870-07cba7df2f15: created successfully Jul 14 21:21:30 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded 1073741824" returned: 0 in 0.574s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:30 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded Jul 14 21:21:30 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:31 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded" returned: 0 in 0.284s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:21:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b7b48e-6e50-4ca6-a407-b4b04ad68a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0409e3-3076-4218-a566-2b997b6b60d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:31 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Volume volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded (b76ba59d-18db-411f-9afb-4abb0cbe6ded): created successfully Jul 14 21:21:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0409e3-3076-4218-a566-2b997b6b60d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Flow 'volume_create_manager' (65d6bb5e-9531-44df-9640-2996b428f5b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:21:31 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-4e401574-b239-441d-a6fa-28dec66bd0f9 tempest-VolumesSnapshotTestJSON-999933281 None] Created volume successfully. Jul 14 21:21:31 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] group_snapshot e93c2e9b-fc06-401e-8870-07cba7df2f15: deleting Jul 14 21:21:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] group_snapshot e93c2e9b-fc06-401e-8870-07cba7df2f15: deleting {{(pid=88300) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 14 21:21:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "cinder-quobyte-016201cc-8947-4592-b61e-1666a60314b2" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-016201cc-8947-4592-b61e-1666a60314b2" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "cinder-quobyte-a8ff851b-768a-4c40-a504-82028f9a1caa" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-a8ff851b-768a-4c40-a504-82028f9a1caa" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] Deleting offline snapshot a8ff851b-768a-4c40-a504-82028f9a1caa of volume 016201cc-8947-4592-b61e-1666a60314b2 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:21:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] snapshot_file for this snap is: volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:21:31 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a402a9b-7e0c-4fc5-bb66-ff8717ab13e0]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:31 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa Jul 14 21:21:31 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:32 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa" returned: 0 in 0.501s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-016201cc-8947-4592-b61e-1666a60314b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:21:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] Creating offline snapshot 536e0f57-ce78-4810-94b9-5d46e64fca25 of volume b76ba59d-18db-411f-9afb-4abb0cbe6ded {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:21:32 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e064f3-4aa6-4e63-a7e1-c3ff3b0d16e9]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:32 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9001e55-7d3d-48b1-b804-e087b1b1c69a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:32 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2 Jul 14 21:21:32 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:32 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded Jul 14 21:21:32 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:32 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2" returned: 0 in 0.381s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:32 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded" returned: 0 in 0.386s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:32 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa Jul 14 21:21:32 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:32 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25 1G Jul 14 21:21:32 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:33 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa" returned: 0 in 0.399s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:33 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa Jul 14 21:21:33 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:33 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25 1G" returned: 0 in 0.502s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:33 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25 Jul 14 21:21:33 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:33 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2.a8ff851b-768a-4c40-a504-82028f9a1caa" returned: 0 in 0.301s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-a8ff851b-768a-4c40-a504-82028f9a1caa" released by "_delete_snapshot" :: held 1.730s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-016201cc-8947-4592-b61e-1666a60314b2" released by "delete_snapshot" :: held 1.776s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:33 devstack cinder-volume[88300]: WARNING cinder.quota [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-140915013 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-140915013, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:21:33 devstack cinder-volume[88300]: WARNING cinder.quota [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-140915013 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-140915013, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:21:33 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] Created reservations ['abcf86b9-d963-4687-979f-137b0d3f6b96', 'dd5fd3f6-7bd7-4f8a-ae0f-4cd7d16bc2d7', 'c361024a-8e5a-4f32-844c-fd2091fa532d', 'ce0815c1-d342-47b9-b85e-9b4df0560b6e'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:21:33 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25" returned: 0 in 0.324s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:33 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25 is being set with open permissions: ugo+rw Jul 14 21:21:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:33 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25 Jul 14 21:21:33 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:33 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a0424c6e-463b-4310-9ee1-b2d761f71f0c tempest-GroupSnapshotsTest-1411126106 None] group_snapshot e93c2e9b-fc06-401e-8870-07cba7df2f15: deleted successfully Jul 14 21:21:33 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25" returned: 0 in 0.280s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:33 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.info Jul 14 21:21:33 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:34 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.info" returned: 0 in 0.294s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:34 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.info is being set with open permissions: ugo+rw Jul 14 21:21:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:34 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.info Jul 14 21:21:34 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "cinder-quobyte-016201cc-8947-4592-b61e-1666a60314b2" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-016201cc-8947-4592-b61e-1666a60314b2" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:34 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffea975a-e84a-4639-bd29-aca7a7351f4b]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:34 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.info" returned: 0 in 0.325s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:34 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-cfebf175-d1ab-4775-8ba8-eb952504f3c0 tempest-VolumesSnapshotTestJSON-999933281 None] Create snapshot completed successfully Jul 14 21:21:34 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2 Jul 14 21:21:34 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:34 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2" returned: 0 in 0.469s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:34 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2 Jul 14 21:21:34 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:35 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-016201cc-8947-4592-b61e-1666a60314b2" returned: 0 in 0.257s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] Lock "cinder-quobyte-016201cc-8947-4592-b61e-1666a60314b2" released by "delete_volume" :: held 0.814s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:35 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] Created reservations ['7a4b99fb-95a0-4596-ae54-35f48cf551f3'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:21:35 devstack cinder-volume[88300]: WARNING cinder.quota [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-140915013 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-140915013, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:21:35 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] Created reservations ['0c15fd51-b784-4a0c-bc95-5b2a5a1e8a43', 'b48c61b2-e70b-474d-a3b1-c48c7cb8c3c3', 'd7d60da7-cf5c-4e46-81be-e7e7dc18fe07', '68a4a928-966b-433f-9e65-4deb867e6a8f'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:21:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:21:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:21:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:35 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:21:35 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:35 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.292s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:35 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:21:35 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-65409afa-aa02-4857-92ef-3d4600ff9f71 tempest-GroupSnapshotsTest-1411126106 None] Delete group completed successfully. Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Flow 'volume_create_manager' (11c6cab9-d35a-4736-9e8e-074ac11f1c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17710b07-1ccd-4c34-955a-12a681d43a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17710b07-1ccd-4c34-955a-12a681d43a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-919300824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a9de47-8d55-44fd-9069-e23797432627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648c85637b4e4c04a6c69d24d7ab2963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:21:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=536e0f57-ce78-4810-94b9-5d46e64fca25,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:21:36Z,use_quota=True,user_id='53e43d748eb14cc1b1b1e6df46403c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8c3609-4edf-40ad-8d5e-e4c2bf2c335a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8c3609-4edf-40ad-8d5e-e4c2bf2c335a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa22c1d-8859-41e9-8981-62ede2b14f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa22c1d-8859-41e9-8981-62ede2b14f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '06a9de47-8d55-44fd-9069-e23797432627', 'volume_name': 'volume-06a9de47-8d55-44fd-9069-e23797432627', 'volume_size': 2, 'snapshot_id': '536e0f57-ce78-4810-94b9-5d46e64fca25'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc31ee8-d875-4fb6-9dfc-0dcb76cc7426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc31ee8-d875-4fb6-9dfc-0dcb76cc7426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f5423f-27ba-48da-8359-3e1e93a26e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:36 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Volume 06a9de47-8d55-44fd-9069-e23797432627: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-06a9de47-8d55-44fd-9069-e23797432627', 'volume_size': 2, 'snapshot_id': '536e0f57-ce78-4810-94b9-5d46e64fca25'} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-quobyte-536e0f57-ce78-4810-94b9-5d46e64fca25-06a9de47-8d55-44fd-9069-e23797432627" by "_create_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-536e0f57-ce78-4810-94b9-5d46e64fca25-06a9de47-8d55-44fd-9069-e23797432627" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Creating volume 06a9de47-8d55-44fd-9069-e23797432627 from snapshot 536e0f57-ce78-4810-94b9-5d46e64fca25 {{(pid=88300) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-quobyte-06a9de47-8d55-44fd-9069-e23797432627" by "_copy_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-06a9de47-8d55-44fd-9069-e23797432627" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] snapshot: 536e0f57-ce78-4810-94b9-5d46e64fca25, volume: 06a9de47-8d55-44fd-9069-e23797432627, {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9469427a-e49a-4b12-8a22-dcfc1a4d9ad3]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:36 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25 Jul 14 21:21:36 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:36 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:21:36 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:36 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25" returned: 0 in 0.482s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Creating direct copy from snapshot {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e8c606-ce29-4210-8919-139934218130]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:36 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.378s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 28 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:21:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:21:37 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded Jul 14 21:21:37 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:37 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded" returned: 0 in 0.677s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:37 devstack cinder-volume[88300]: DEBUG cinder.utils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Path /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06a9de47-8d55-44fd-9069-e23797432627 not found in is_blk_device check {{(pid=88300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 21:21:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06a9de47-8d55-44fd-9069-e23797432627 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:37 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06a9de47-8d55-44fd-9069-e23797432627 Jul 14 21:21:37 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:44 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06a9de47-8d55-44fd-9069-e23797432627" returned: 0 in 6.957s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:44 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad809b02-2c95-4440-93c5-6f3d7fefabb7]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:44 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded Jul 14 21:21:44 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:45 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded" returned: 0 in 0.836s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:45 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Image conversion details: src /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded, size 1024.00 MB, duration 6.96 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06a9de47-8d55-44fd-9069-e23797432627 {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:21:45 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Converted 1024.00 MB image at 147.16 MB/s Jul 14 21:21:45 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06a9de47-8d55-44fd-9069-e23797432627 is being set with open permissions: ugo+rw Jul 14 21:21:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06a9de47-8d55-44fd-9069-e23797432627 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:45 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06a9de47-8d55-44fd-9069-e23797432627 Jul 14 21:21:45 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:45 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06a9de47-8d55-44fd-9069-e23797432627" returned: 0 in 0.523s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:45 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-06a9de47-8d55-44fd-9069-e23797432627" released by "_copy_volume_from_snapshot" :: held 9.641s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:45 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-536e0f57-ce78-4810-94b9-5d46e64fca25-06a9de47-8d55-44fd-9069-e23797432627" released by "_create_volume_from_snapshot" :: held 9.681s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.700s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f5423f-27ba-48da-8359-3e1e93a26e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06a9de47-8d55-44fd-9069-e23797432627', 'volume_size': 2, 'snapshot_id': '536e0f57-ce78-4810-94b9-5d46e64fca25'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92f8992-1645-4663-8670-828c096c1bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:46 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Volume volume-06a9de47-8d55-44fd-9069-e23797432627 (06a9de47-8d55-44fd-9069-e23797432627): created successfully Jul 14 21:21:46 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92f8992-1645-4663-8670-828c096c1bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:46 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Flow 'volume_create_manager' (11c6cab9-d35a-4736-9e8e-074ac11f1c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:21:46 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-3194bd04-0521-4ef3-b2dc-cdf64a41a2c4 tempest-VolumesSnapshotTestJSON-999933281 None] Created volume successfully. Jul 14 21:21:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-06a9de47-8d55-44fd-9069-e23797432627-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-06a9de47-8d55-44fd-9069-e23797432627-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-quobyte-06a9de47-8d55-44fd-9069-e23797432627" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-06a9de47-8d55-44fd-9069-e23797432627" acquired by "delete_volume" :: waited 0.016s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:46 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f89c2a0-e91d-4d5e-98e2-593ee2e9c5be]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06a9de47-8d55-44fd-9069-e23797432627 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:47 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06a9de47-8d55-44fd-9069-e23797432627 Jul 14 21:21:47 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:47 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06a9de47-8d55-44fd-9069-e23797432627" returned: 0 in 0.605s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06a9de47-8d55-44fd-9069-e23797432627 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:47 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06a9de47-8d55-44fd-9069-e23797432627 Jul 14 21:21:47 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:48 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06a9de47-8d55-44fd-9069-e23797432627" returned: 0 in 0.559s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:48 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-06a9de47-8d55-44fd-9069-e23797432627" released by "delete_volume" :: held 1.228s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:48 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] Created reservations ['cbb27500-80b3-429d-85ed-c10287d6f41c', 'b2405caf-7133-45e9-adf3-a1d727a363db', 'c9811b16-e19b-47ca-a0b7-7b1b938ca793', '3ad9c225-9397-4545-b0e0-45ed79499a71'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:21:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:21:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:21:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:48 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:21:48 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:48 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.321s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:48 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:21:48 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] Deleted volume successfully. Jul 14 21:21:48 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-bdf3cfb2-f892-49b1-8815-c11dad858b6b tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-06a9de47-8d55-44fd-9069-e23797432627-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:49 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-536e0f57-ce78-4810-94b9-5d46e64fca25-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:49 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-536e0f57-ce78-4810-94b9-5d46e64fca25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:49 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-quobyte-b76ba59d-18db-411f-9afb-4abb0cbe6ded" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:49 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-b76ba59d-18db-411f-9afb-4abb0cbe6ded" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:49 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-quobyte-536e0f57-ce78-4810-94b9-5d46e64fca25" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:49 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-536e0f57-ce78-4810-94b9-5d46e64fca25" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] Deleting offline snapshot 536e0f57-ce78-4810-94b9-5d46e64fca25 of volume b76ba59d-18db-411f-9afb-4abb0cbe6ded {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:21:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] snapshot_file for this snap is: volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:21:49 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa76a075-5b0e-4913-bc21-86ecfb5debc1]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:49 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-71fba014-adb0-460e-b625-23fef5375881 req-d601ffb1-1210-46d3-a135-780870c169c7 tempest-AttachVolumeNegativeTest-850271826 None] Terminate volume connection completed successfully. Jul 14 21:21:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-71fba014-adb0-460e-b625-23fef5375881 req-d601ffb1-1210-46d3-a135-780870c169c7 tempest-AttachVolumeNegativeTest-850271826 None] Deleting attachment 228dfd11-0b62-490c-a088-a1d2f8ed9b8d. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:21:49 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25 Jul 14 21:21:49 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:50 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25" returned: 0 in 0.746s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:21:50 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c92325-1fa5-4ed6-ba84-cf8251b60b6a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:50 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded Jul 14 21:21:50 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:50 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded" returned: 0 in 0.636s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:50 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25 Jul 14 21:21:50 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:50 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:21:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Flow 'volume_create_manager' (cf987f94-b674-431b-a39b-d7a66c526878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:21:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676b1803-c5e7-4f36-9738-306c3d3c4f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676b1803-c5e7-4f36-9738-306c3d3c4f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1148443135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8688a49-f33c-4a89-b766-d0cbf858270f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164b725a54404897a8174d357dc0142d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:21:51Z,use_quota=True,user_id='ebaa3f93fcb84ac1836eb21c6d6e282a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e98bbe-0cf3-4743-a5e2-d3f17764847c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e98bbe-0cf3-4743-a5e2-d3f17764847c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de17e95a-8748-4acd-9d16-5eeb06071182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de17e95a-8748-4acd-9d16-5eeb06071182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8688a49-f33c-4a89-b766-d0cbf858270f', 'volume_name': 'volume-b8688a49-f33c-4a89-b766-d0cbf858270f', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3e392a-af60-4d68-9d90-57f86bf64e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3e392a-af60-4d68-9d90-57f86bf64e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be8227c-6cc9-43d3-be6d-9ed2e0e591e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:51 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Volume b8688a49-f33c-4a89-b766-d0cbf858270f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8688a49-f33c-4a89-b766-d0cbf858270f', 'volume_size': 1} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1148443135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8688a49-f33c-4a89-b766-d0cbf858270f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164b725a54404897a8174d357dc0142d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:21:51Z,use_quota=True,user_id='ebaa3f93fcb84ac1836eb21c6d6e282a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Creating volume b8688a49-f33c-4a89-b766-d0cbf858270f {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:21:51 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8688a49-f33c-4a89-b766-d0cbf858270f 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:51 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8688a49-f33c-4a89-b766-d0cbf858270f 1073741824 Jul 14 21:21:51 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:51 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25" returned: 0 in 0.764s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:51 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25 Jul 14 21:21:51 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:51 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded.536e0f57-ce78-4810-94b9-5d46e64fca25" returned: 0 in 0.417s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-536e0f57-ce78-4810-94b9-5d46e64fca25" released by "_delete_snapshot" :: held 2.762s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:52 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-b76ba59d-18db-411f-9afb-4abb0cbe6ded" released by "delete_snapshot" :: held 2.817s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8688a49-f33c-4a89-b766-d0cbf858270f 1073741824" returned: 0 in 0.921s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8688a49-f33c-4a89-b766-d0cbf858270f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:52 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8688a49-f33c-4a89-b766-d0cbf858270f Jul 14 21:21:52 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] Created reservations ['9b18c1f9-8ab1-44eb-85e0-b0ca5f905161', '4719ac4d-8c50-44ce-8609-c776b739fd69', '49efb80f-a003-458a-aadd-acc4837780dc', '80206f9a-11ab-4531-bc8f-f48fc9687c53'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:21:52 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] Delete snapshot completed successfully. Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5c994f13-8bfe-43b8-957a-e9a2fe37c3c5 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-536e0f57-ce78-4810-94b9-5d46e64fca25-delete_snapshot" released by "delete_snapshot" :: held 3.281s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:52 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8688a49-f33c-4a89-b766-d0cbf858270f" returned: 0 in 0.468s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be8227c-6cc9-43d3-be6d-9ed2e0e591e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8688a49-f33c-4a89-b766-d0cbf858270f', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b8b977-1f43-4b65-8eb2-b3e79cde97e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:52 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Volume volume-b8688a49-f33c-4a89-b766-d0cbf858270f (b8688a49-f33c-4a89-b766-d0cbf858270f): created successfully Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b8b977-1f43-4b65-8eb2-b3e79cde97e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Flow 'volume_create_manager' (cf987f94-b674-431b-a39b-d7a66c526878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:21:52 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e794171a-61b1-4893-ac28-7cefe0ef0ee2 tempest-VolumesActionsTest-185324529 None] Created volume successfully. Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-b76ba59d-18db-411f-9afb-4abb0cbe6ded-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-b76ba59d-18db-411f-9afb-4abb0cbe6ded-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-quobyte-b76ba59d-18db-411f-9afb-4abb0cbe6ded" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-b76ba59d-18db-411f-9afb-4abb0cbe6ded" acquired by "delete_volume" :: waited 0.026s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-80045be9-93bd-43e6-b0e6-efd96070ec6d tempest-VolumesActionsTest-185324529 None] Acquiring lock "cinder-b8688a49-f33c-4a89-b766-d0cbf858270f" by "attach_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:53 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad7606d-31d8-4301-8741-ca776efe07f7]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-80045be9-93bd-43e6-b0e6-efd96070ec6d tempest-VolumesActionsTest-185324529 None] Lock "cinder-b8688a49-f33c-4a89-b766-d0cbf858270f" acquired by "attach_volume" :: waited 0.081s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:53 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-80045be9-93bd-43e6-b0e6-efd96070ec6d tempest-VolumesActionsTest-185324529 None] Attaching volume b8688a49-f33c-4a89-b766-d0cbf858270f to instance ab04716e-4fc4-4889-969d-3c3829739dd4 at mountpoint /dev/vdb on host None. Jul 14 21:21:53 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded Jul 14 21:21:53 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:53 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-80045be9-93bd-43e6-b0e6-efd96070ec6d tempest-VolumesActionsTest-185324529 None] Attach volume completed successfully. Jul 14 21:21:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-80045be9-93bd-43e6-b0e6-efd96070ec6d tempest-VolumesActionsTest-185324529 None] Lock "cinder-b8688a49-f33c-4a89-b766-d0cbf858270f" released by "attach_volume" :: held 0.205s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:53 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded" returned: 0 in 0.749s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:53 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded Jul 14 21:21:53 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:54 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b76ba59d-18db-411f-9afb-4abb0cbe6ded" returned: 0 in 0.507s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-b76ba59d-18db-411f-9afb-4abb0cbe6ded" released by "delete_volume" :: held 1.419s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:54 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] Created reservations ['b8978c53-70fe-4258-8787-65af4ddd099a', 'b9b48f86-269a-4025-925f-d82053aec2a5', '1c6a640e-cb0b-4342-b72c-4de1f54ccb33', '0d057bd8-eb3b-4a5e-a61f-e6cb4b2dc45c'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:21:54 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-456247a5-24c8-4e40-9d4e-9b8827500000 tempest-VolumesActionsTest-103619004 None] Terminate volume connection completed successfully. Jul 14 21:21:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:21:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:21:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:54 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:21:54 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-456247a5-24c8-4e40-9d4e-9b8827500000 tempest-VolumesActionsTest-103619004 None] Acquiring lock "cinder-b8688a49-f33c-4a89-b766-d0cbf858270f-detach_volume" by "detach_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-456247a5-24c8-4e40-9d4e-9b8827500000 tempest-VolumesActionsTest-103619004 None] Lock "cinder-b8688a49-f33c-4a89-b766-d0cbf858270f-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:54 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-456247a5-24c8-4e40-9d4e-9b8827500000 tempest-VolumesActionsTest-103619004 None] Detaching volume b8688a49-f33c-4a89-b766-d0cbf858270f from instance ab04716e-4fc4-4889-969d-3c3829739dd4. Jul 14 21:21:54 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-456247a5-24c8-4e40-9d4e-9b8827500000 tempest-VolumesActionsTest-103619004 None] Detach volume completed successfully. Jul 14 21:21:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-456247a5-24c8-4e40-9d4e-9b8827500000 tempest-VolumesActionsTest-103619004 None] Lock "cinder-b8688a49-f33c-4a89-b766-d0cbf858270f-detach_volume" released by "detach_volume" :: held 0.104s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:54 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.338s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:54 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:21:54 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] Deleted volume successfully. Jul 14 21:21:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3bb47120-e2c4-4c9b-b913-989d92b6b16c tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-b76ba59d-18db-411f-9afb-4abb0cbe6ded-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4a56cc4a-90db-49a7-8d81-e5cbd25edba0 tempest-VolumesActionsTest-185324529 None] Acquiring lock "cinder-b8688a49-f33c-4a89-b766-d0cbf858270f-detach_volume" by "detach_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4a56cc4a-90db-49a7-8d81-e5cbd25edba0 tempest-VolumesActionsTest-185324529 None] Lock "cinder-b8688a49-f33c-4a89-b766-d0cbf858270f-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:55 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-4a56cc4a-90db-49a7-8d81-e5cbd25edba0 tempest-VolumesActionsTest-185324529 None] Volume detach called, but volume not attached. Jul 14 21:21:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4a56cc4a-90db-49a7-8d81-e5cbd25edba0 tempest-VolumesActionsTest-185324529 None] Lock "cinder-b8688a49-f33c-4a89-b766-d0cbf858270f-detach_volume" released by "detach_volume" :: held 0.021s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] Acquiring lock "cinder-b8688a49-f33c-4a89-b766-d0cbf858270f-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] Lock "cinder-b8688a49-f33c-4a89-b766-d0cbf858270f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] Acquiring lock "cinder-quobyte-b8688a49-f33c-4a89-b766-d0cbf858270f" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:21:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] Lock "cinder-quobyte-b8688a49-f33c-4a89-b766-d0cbf858270f" acquired by "delete_volume" :: waited 0.041s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:21:55 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[12137124-67cd-4330-9dfe-81a0418a38bf]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8688a49-f33c-4a89-b766-d0cbf858270f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:56 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8688a49-f33c-4a89-b766-d0cbf858270f Jul 14 21:21:56 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Flow 'volume_create_manager' (240eb0df-7b46-42ef-a729-486d93d0940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:21:56 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a564c3-3b10-48c5-a136-e9a01be3b42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8688a49-f33c-4a89-b766-d0cbf858270f" returned: 0 in 0.577s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8688a49-f33c-4a89-b766-d0cbf858270f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a564c3-3b10-48c5-a136-e9a01be3b42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-60619166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648c85637b4e4c04a6c69d24d7ab2963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:21:56Z,use_quota=True,user_id='53e43d748eb14cc1b1b1e6df46403c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:56 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8688a49-f33c-4a89-b766-d0cbf858270f Jul 14 21:21:56 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30049879-f276-4e4b-a34d-f921b73e34c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30049879-f276-4e4b-a34d-f921b73e34c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a0f4ae-102d-4e1d-ac18-31f2342927f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a0f4ae-102d-4e1d-ac18-31f2342927f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8', 'volume_name': 'volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb4f34f-a2cb-41d5-8d73-ad2420e29768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb4f34f-a2cb-41d5-8d73-ad2420e29768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73346402-dfdd-4714-ae26-f138545dfb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:56 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Volume 2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8', 'volume_size': 1} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-60619166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648c85637b4e4c04a6c69d24d7ab2963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:21:56Z,use_quota=True,user_id='53e43d748eb14cc1b1b1e6df46403c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Creating volume 2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:21:56 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:56 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 1073741824 Jul 14 21:21:56 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:56 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8688a49-f33c-4a89-b766-d0cbf858270f" returned: 0 in 0.481s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] Lock "cinder-quobyte-b8688a49-f33c-4a89-b766-d0cbf858270f" released by "delete_volume" :: held 1.160s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:57 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] Created reservations ['646e7ef4-bbb6-4c88-86ac-f72226c0e0ed', '331e9e4f-ebad-40de-be5a-0089f6cc6675', 'fdcc20d6-785d-4dce-b59d-9d68f8d4ecea', '8468a2fe-b3dc-4cf9-86cf-b2ffa0cda96e'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:21:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:21:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:21:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:57 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:21:57 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:57 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 1073741824" returned: 0 in 0.964s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:57 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.426s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:57 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:21:57 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 Jul 14 21:21:57 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:57 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] Deleted volume successfully. Jul 14 21:21:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3b60a28c-6f3c-4a0d-9000-79a00a1508db tempest-VolumesActionsTest-185324529 None] Lock "cinder-b8688a49-f33c-4a89-b766-d0cbf858270f-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:21:58 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8" returned: 0 in 0.403s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:21:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:21:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73346402-dfdd-4714-ae26-f138545dfb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1dd0be4-311d-4238-8315-57003ffcffa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:21:58 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Volume volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 (2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8): created successfully Jul 14 21:21:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1dd0be4-311d-4238-8315-57003ffcffa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:21:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Flow 'volume_create_manager' (240eb0df-7b46-42ef-a729-486d93d0940f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:21:58 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-fa66ded7-a7b1-4cc1-83a0-e3d9da6b74e0 tempest-VolumesSnapshotTestJSON-999933281 None] Created volume successfully. Jul 14 21:21:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:21:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:21:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] Creating offline snapshot 1b2afdef-d059-4df1-9d97-7e1f249b9723 of volume 2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:21:58 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[501501dc-e4d2-4bd8-9c68-75d070dff0be]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:21:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:59 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 Jul 14 21:21:59 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:21:59 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 14 21:21:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8" returned: 0 in 0.567s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:21:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:21:59 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723 1G Jul 14 21:21:59 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:00 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723 1G" returned: 0 in 0.673s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:00 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723 Jul 14 21:22:00 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:00 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723" returned: 0 in 0.327s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:00 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723 is being set with open permissions: ugo+rw Jul 14 21:22:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:00 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723 Jul 14 21:22:00 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:00 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723" returned: 0 in 0.266s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:00 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.info Jul 14 21:22:00 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:01 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.info" returned: 0 in 0.329s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:01 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.info is being set with open permissions: ugo+rw Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:01 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.info Jul 14 21:22:01 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:01 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.info" returned: 0 in 0.412s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.706s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:01 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-3d06eefe-d797-4617-a070-e44c7f9604c5 tempest-VolumesSnapshotTestJSON-999933281 None] Create snapshot completed successfully Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Flow 'volume_create_manager' (e8d4012f-96f3-447c-bd04-6151cfe21d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f5d520-0267-4a1e-83f4-d35d09a0a897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f5d520-0267-4a1e-83f4-d35d09a0a897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1240095929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60322b8c-e91d-4a4b-af08-af951c538911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164b725a54404897a8174d357dc0142d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:02Z,use_quota=True,user_id='ebaa3f93fcb84ac1836eb21c6d6e282a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7820b68d-ac2f-4b24-98b2-5872f9ab2c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7820b68d-ac2f-4b24-98b2-5872f9ab2c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2076c770-d266-45f0-b92c-bee09f58f3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2076c770-d266-45f0-b92c-bee09f58f3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60322b8c-e91d-4a4b-af08-af951c538911', 'volume_name': 'volume-60322b8c-e91d-4a4b-af08-af951c538911', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5b1b0e-af29-46cc-b16c-4d42997e7d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5b1b0e-af29-46cc-b16c-4d42997e7d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acf9b0d-d600-4f6d-8d21-d6859891cb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:01 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Volume 60322b8c-e91d-4a4b-af08-af951c538911: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60322b8c-e91d-4a4b-af08-af951c538911', 'volume_size': 1} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1240095929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60322b8c-e91d-4a4b-af08-af951c538911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164b725a54404897a8174d357dc0142d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:02Z,use_quota=True,user_id='ebaa3f93fcb84ac1836eb21c6d6e282a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Creating volume 60322b8c-e91d-4a4b-af08-af951c538911 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:22:01 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:22:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-60322b8c-e91d-4a4b-af08-af951c538911 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:01 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-60322b8c-e91d-4a4b-af08-af951c538911 1073741824 Jul 14 21:22:01 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:02 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-60322b8c-e91d-4a4b-af08-af951c538911 1073741824" returned: 0 in 0.638s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-60322b8c-e91d-4a4b-af08-af951c538911 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:02 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-60322b8c-e91d-4a4b-af08-af951c538911 Jul 14 21:22:02 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Flow 'volume_create_manager' (81dff939-0c58-4fab-929c-222188e0fcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f20d6d8-87b8-476d-a921-58a26cf5c80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f20d6d8-87b8-476d-a921-58a26cf5c80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-998335621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea8bd2a-b635-41fc-baca-2562f940c114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648c85637b4e4c04a6c69d24d7ab2963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b2afdef-d059-4df1-9d97-7e1f249b9723,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:03Z,use_quota=True,user_id='53e43d748eb14cc1b1b1e6df46403c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528fcff5-a597-4e23-a053-398426c48e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528fcff5-a597-4e23-a053-398426c48e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f04d5a-caa8-4313-9eb5-8d108288962d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f04d5a-caa8-4313-9eb5-8d108288962d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8ea8bd2a-b635-41fc-baca-2562f940c114', 'volume_name': 'volume-8ea8bd2a-b635-41fc-baca-2562f940c114', 'volume_size': 1, 'snapshot_id': '1b2afdef-d059-4df1-9d97-7e1f249b9723'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96ea999-3c42-4c13-ad53-c9502924df0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96ea999-3c42-4c13-ad53-c9502924df0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c490a6-4e1a-423b-a2a7-5f0a323210f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:02 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Volume 8ea8bd2a-b635-41fc-baca-2562f940c114: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8ea8bd2a-b635-41fc-baca-2562f940c114', 'volume_size': 1, 'snapshot_id': '1b2afdef-d059-4df1-9d97-7e1f249b9723'} Jul 14 21:22:02 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-60322b8c-e91d-4a4b-af08-af951c538911" returned: 0 in 0.330s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-quobyte-1b2afdef-d059-4df1-9d97-7e1f249b9723-8ea8bd2a-b635-41fc-baca-2562f940c114" by "_create_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acf9b0d-d600-4f6d-8d21-d6859891cb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60322b8c-e91d-4a4b-af08-af951c538911', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acfbab1-c3b7-4944-ae89-102468bd1832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-1b2afdef-d059-4df1-9d97-7e1f249b9723-8ea8bd2a-b635-41fc-baca-2562f940c114" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Creating volume 8ea8bd2a-b635-41fc-baca-2562f940c114 from snapshot 1b2afdef-d059-4df1-9d97-7e1f249b9723 {{(pid=88300) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-quobyte-8ea8bd2a-b635-41fc-baca-2562f940c114" by "_copy_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:03 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Volume volume-60322b8c-e91d-4a4b-af08-af951c538911 (60322b8c-e91d-4a4b-af08-af951c538911): created successfully Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acfbab1-c3b7-4944-ae89-102468bd1832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Flow 'volume_create_manager' (e8d4012f-96f3-447c-bd04-6151cfe21d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-8ea8bd2a-b635-41fc-baca-2562f940c114" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] snapshot: 1b2afdef-d059-4df1-9d97-7e1f249b9723, volume: 8ea8bd2a-b635-41fc-baca-2562f940c114, {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 21:22:03 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-48c44791-388f-4480-b81a-e846fc641864 tempest-VolumesActionsTest-185324529 None] Created volume successfully. Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7323c8ed-3e2c-43f5-95b8-c76708e1db16]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:03 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723 Jul 14 21:22:03 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:03 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723" returned: 0 in 0.521s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Creating direct copy from snapshot {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cab765d-193b-4f1e-af8c-e9d565324457]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:03 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 Jul 14 21:22:03 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:04 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] Acquiring lock "cinder-60322b8c-e91d-4a4b-af08-af951c538911-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:04 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] Lock "cinder-60322b8c-e91d-4a4b-af08-af951c538911-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:04 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:04 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] Acquiring lock "cinder-quobyte-60322b8c-e91d-4a4b-af08-af951c538911" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8" returned: 0 in 0.562s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:04 devstack cinder-volume[88300]: DEBUG cinder.utils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Path /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8ea8bd2a-b635-41fc-baca-2562f940c114 not found in is_blk_device check {{(pid=88300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 21:22:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8ea8bd2a-b635-41fc-baca-2562f940c114 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:04 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8ea8bd2a-b635-41fc-baca-2562f940c114 Jul 14 21:22:04 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:04 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] Lock "cinder-quobyte-60322b8c-e91d-4a4b-af08-af951c538911" acquired by "delete_volume" :: waited 0.085s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:04 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6937f1f-0e08-4b65-a48a-97c1362ac11e]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-60322b8c-e91d-4a4b-af08-af951c538911 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:04 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-60322b8c-e91d-4a4b-af08-af951c538911 Jul 14 21:22:04 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:05 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-60322b8c-e91d-4a4b-af08-af951c538911" returned: 0 in 0.795s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-60322b8c-e91d-4a4b-af08-af951c538911 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:05 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-60322b8c-e91d-4a4b-af08-af951c538911 Jul 14 21:22:05 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:06 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-60322b8c-e91d-4a4b-af08-af951c538911" returned: 0 in 0.959s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] Lock "cinder-quobyte-60322b8c-e91d-4a4b-af08-af951c538911" released by "delete_volume" :: held 1.903s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:06 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] Created reservations ['976ef4f4-97ba-4366-ae85-0dcf986c6d70', '5c642807-51f2-4f0b-906e-f95fb4a2cb49', 'c1e8e0e4-a4fa-49f3-853d-1d1998ab1ee8', '5dc04391-7f6c-49b0-9cb1-2a3998c8b9fe'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:22:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:06 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:22:06 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:07 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.782s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:07 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:22:07 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] Deleted volume successfully. Jul 14 21:22:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-26d71c30-7264-424c-8d5c-79c50d22c0a4 tempest-VolumesActionsTest-103619004 None] Lock "cinder-60322b8c-e91d-4a4b-af08-af951c538911-delete_volume" released by "delete_volume" :: held 3.530s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:09 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=136,cinder:INSERT=35,cinder:UPDATE=125,cinder:DELETE=10 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:22:09 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:UPDATE=128,cinder:SELECT=114,cinder:INSERT=28,cinder:DELETE=4 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:22:09 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:22:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Flow 'volume_create_manager' (14a61d3d-a358-4bbc-8eca-83ca875290d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4cb41c-95da-4e9a-8492-8b0ef79afc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4cb41c-95da-4e9a-8492-8b0ef79afc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1287476810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164b725a54404897a8174d357dc0142d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:10Z,use_quota=True,user_id='ebaa3f93fcb84ac1836eb21c6d6e282a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4875ce92-0f97-4f22-bd9a-c8d1eda0db12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4875ce92-0f97-4f22-bd9a-c8d1eda0db12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e1f0a8-61a0-40aa-bdc7-4be7b8fbf2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e1f0a8-61a0-40aa-bdc7-4be7b8fbf2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df', 'volume_name': 'volume-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59828c0-0881-48a2-80ba-4dbedf111112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59828c0-0881-48a2-80ba-4dbedf111112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443eb7c0-a298-429f-88ad-75f1de44717c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:10 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Volume cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df', 'volume_size': 1} Jul 14 21:22:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:11 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8ea8bd2a-b635-41fc-baca-2562f940c114" returned: 0 in 7.290s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:11 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc76223-2c53-40da-b921-85cd21058544]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:11 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 Jul 14 21:22:11 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:12 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8" returned: 0 in 0.762s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Image conversion details: src /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8, size 1024.00 MB, duration 7.29 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8ea8bd2a-b635-41fc-baca-2562f940c114 {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:22:12 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Converted 1024.00 MB image at 140.46 MB/s Jul 14 21:22:12 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8ea8bd2a-b635-41fc-baca-2562f940c114 is being set with open permissions: ugo+rw Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8ea8bd2a-b635-41fc-baca-2562f940c114 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:12 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8ea8bd2a-b635-41fc-baca-2562f940c114 Jul 14 21:22:12 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:12 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8ea8bd2a-b635-41fc-baca-2562f940c114" returned: 0 in 0.391s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-8ea8bd2a-b635-41fc-baca-2562f940c114" released by "_copy_volume_from_snapshot" :: held 9.703s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-1b2afdef-d059-4df1-9d97-7e1f249b9723-8ea8bd2a-b635-41fc-baca-2562f940c114" released by "_create_volume_from_snapshot" :: held 9.774s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.829s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.456s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1287476810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164b725a54404897a8174d357dc0142d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:10Z,use_quota=True,user_id='ebaa3f93fcb84ac1836eb21c6d6e282a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Creating volume cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:22:12 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:12 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df 1073741824 Jul 14 21:22:12 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c490a6-4e1a-423b-a2a7-5f0a323210f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea8bd2a-b635-41fc-baca-2562f940c114', 'volume_size': 1, 'snapshot_id': '1b2afdef-d059-4df1-9d97-7e1f249b9723'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5f1c17-ab97-429a-88fd-116667fe8398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:12 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Volume volume-8ea8bd2a-b635-41fc-baca-2562f940c114 (8ea8bd2a-b635-41fc-baca-2562f940c114): created successfully Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5f1c17-ab97-429a-88fd-116667fe8398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Flow 'volume_create_manager' (81dff939-0c58-4fab-929c-222188e0fcf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:12 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0ae72cb5-8935-4068-acf0-03c3acb87557 tempest-VolumesSnapshotTestJSON-999933281 None] Created volume successfully. Jul 14 21:22:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-8ea8bd2a-b635-41fc-baca-2562f940c114-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-8ea8bd2a-b635-41fc-baca-2562f940c114-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:13 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df 1073741824" returned: 0 in 0.726s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-quobyte-8ea8bd2a-b635-41fc-baca-2562f940c114" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-8ea8bd2a-b635-41fc-baca-2562f940c114" acquired by "delete_volume" :: waited 0.048s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:13 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df Jul 14 21:22:13 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:13 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccdd5d8-28e3-4a15-b171-b12b2e71289b]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8ea8bd2a-b635-41fc-baca-2562f940c114 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:13 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8ea8bd2a-b635-41fc-baca-2562f940c114 Jul 14 21:22:13 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:14 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df" returned: 0 in 0.539s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:22:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443eb7c0-a298-429f-88ad-75f1de44717c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b4032f-c7d8-49a1-b278-b116f62299ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:14 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Volume volume-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df (cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df): created successfully Jul 14 21:22:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b4032f-c7d8-49a1-b278-b116f62299ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Flow 'volume_create_manager' (14a61d3d-a358-4bbc-8eca-83ca875290d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:14 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-fdf6c4e4-52b9-4101-9a63-5b82f48885a8 tempest-VolumesActionsTest-185324529 None] Created volume successfully. Jul 14 21:22:14 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8ea8bd2a-b635-41fc-baca-2562f940c114" returned: 0 in 0.773s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8ea8bd2a-b635-41fc-baca-2562f940c114 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:14 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8ea8bd2a-b635-41fc-baca-2562f940c114 Jul 14 21:22:14 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:14 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8ea8bd2a-b635-41fc-baca-2562f940c114" returned: 0 in 0.364s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-8ea8bd2a-b635-41fc-baca-2562f940c114" released by "delete_volume" :: held 1.204s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:14 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] Created reservations ['bef34c7e-1591-46ec-8a21-16f8e94e7517', 'a5a3ef57-b3fe-4ad5-b8a7-976490880d42', 'a9a34f38-c173-4db1-bb27-a4be8b44f3cf', 'c987d83e-ba68-4aad-bedb-312ba16fc5cc'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:15 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:22:15 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] Acquiring lock "cinder-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] Lock "cinder-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] Acquiring lock "cinder-quobyte-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] Lock "cinder-quobyte-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df" acquired by "delete_volume" :: waited 0.038s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[8818bbee-1dd2-4d2b-9060-2703e4d08f6a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:15 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.475s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:22:15 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] Deleted volume successfully. Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-89a6493c-6e52-4b51-bbac-bd96e567f313 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-8ea8bd2a-b635-41fc-baca-2562f940c114-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:15 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df Jul 14 21:22:15 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-1b2afdef-d059-4df1-9d97-7e1f249b9723-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-1b2afdef-d059-4df1-9d97-7e1f249b9723-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-quobyte-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-quobyte-1b2afdef-d059-4df1-9d97-7e1f249b9723" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-1b2afdef-d059-4df1-9d97-7e1f249b9723" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] Deleting offline snapshot 1b2afdef-d059-4df1-9d97-7e1f249b9723 of volume 2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] snapshot_file for this snap is: volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a695b6-e6ac-4da1-a11c-55308ae18978]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:16 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723 Jul 14 21:22:16 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:16 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df" returned: 0 in 0.656s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:16 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df Jul 14 21:22:16 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:16 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723" returned: 0 in 0.441s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:22:16 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9a9c0b-cbba-47fb-abc0-faba41463e17]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:16 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df" returned: 0 in 0.378s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] Lock "cinder-quobyte-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df" released by "delete_volume" :: held 1.123s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:16 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 Jul 14 21:22:16 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:16 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] Created reservations ['3ee55bce-7a1e-49c5-9616-bc78b7b45b2a', '2ead3573-f76c-4af2-93f2-b838eae6a7e1', 'a1961205-a18a-4bd7-8e2f-93c9046a5e7c', '6b6040a4-cf84-459f-a584-615a9f644ffc'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:22:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:16 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:22:16 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:16 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8" returned: 0 in 0.497s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:16 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723 Jul 14 21:22:16 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:17 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.288s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:17 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:22:17 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] Deleted volume successfully. Jul 14 21:22:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-85a63b4a-35a6-4477-abf4-5fe9a4b9a4e6 tempest-VolumesActionsTest-103619004 None] Lock "cinder-cb6ffe3f-6081-4a79-b6d3-3e79a97bd0df-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:17 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723" returned: 0 in 0.421s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:17 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723 Jul 14 21:22:17 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:17 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8.1b2afdef-d059-4df1-9d97-7e1f249b9723" returned: 0 in 0.286s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-1b2afdef-d059-4df1-9d97-7e1f249b9723" released by "_delete_snapshot" :: held 1.780s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8" released by "delete_snapshot" :: held 1.813s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:17 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] Created reservations ['51c89cb1-1221-4b57-bd5a-99db7cd85280', '8b775ee2-abd7-4795-8cec-1224c5099ea4', '1dd94546-e6f8-4818-ab7a-4a35c43f99e5', '90b2600f-1785-44bd-9064-95e36d4be99c'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:22:17 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] Delete snapshot completed successfully. Jul 14 21:22:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1bc2c7f3-2dd9-4929-ba4f-a6db871ce213 tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-1b2afdef-d059-4df1-9d97-7e1f249b9723-delete_snapshot" released by "delete_snapshot" :: held 2.005s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-quobyte-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8" acquired by "delete_volume" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21cf2dd-66e1-4d51-9482-275aae767222]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Flow 'volume_create_manager' (495b1766-2d91-4ef6-bb50-4a3fa5f6f49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebe6a62-0a63-4066-8db8-f87c8ec30afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebe6a62-0a63-4066-8db8-f87c8ec30afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-278631914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6edf91d8-0056-444f-bcb6-dae4e81d32ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164b725a54404897a8174d357dc0142d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:18Z,use_quota=True,user_id='ebaa3f93fcb84ac1836eb21c6d6e282a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113e4e87-3367-43c0-9289-66e96dc431d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113e4e87-3367-43c0-9289-66e96dc431d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54402026-2c42-4208-8594-c10ff3e3d7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54402026-2c42-4208-8594-c10ff3e3d7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6edf91d8-0056-444f-bcb6-dae4e81d32ab', 'volume_name': 'volume-6edf91d8-0056-444f-bcb6-dae4e81d32ab', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ae8f96-00d7-40b9-a129-eadc0c0501f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ae8f96-00d7-40b9-a129-eadc0c0501f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8db581-01e0-4740-b206-9b88ca344348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:18 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Volume 6edf91d8-0056-444f-bcb6-dae4e81d32ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6edf91d8-0056-444f-bcb6-dae4e81d32ab', 'volume_size': 1} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-278631914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6edf91d8-0056-444f-bcb6-dae4e81d32ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164b725a54404897a8174d357dc0142d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:18Z,use_quota=True,user_id='ebaa3f93fcb84ac1836eb21c6d6e282a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Creating volume 6edf91d8-0056-444f-bcb6-dae4e81d32ab {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:22:18 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6edf91d8-0056-444f-bcb6-dae4e81d32ab 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:18 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 Jul 14 21:22:18 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:18 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6edf91d8-0056-444f-bcb6-dae4e81d32ab 1073741824 Jul 14 21:22:18 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:18 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8" returned: 0 in 0.478s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:18 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8 Jul 14 21:22:18 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:19 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6edf91d8-0056-444f-bcb6-dae4e81d32ab 1073741824" returned: 0 in 0.471s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6edf91d8-0056-444f-bcb6-dae4e81d32ab {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:19 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6edf91d8-0056-444f-bcb6-dae4e81d32ab Jul 14 21:22:19 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:19 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8" returned: 0 in 0.321s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8" released by "delete_volume" :: held 0.887s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] Created reservations ['100f89eb-1d75-446e-a570-40b578b5d1eb', '06b78e22-e2dd-491e-a6aa-c1e03c9156ec', 'bd4ef2af-7768-488b-9f97-5162b7323086', '7a13f9a2-231c-4bcf-a6bc-5ac28603958f'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:19 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:22:19 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:19 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6edf91d8-0056-444f-bcb6-dae4e81d32ab" returned: 0 in 0.387s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8db581-01e0-4740-b206-9b88ca344348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6edf91d8-0056-444f-bcb6-dae4e81d32ab', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7404bb73-48be-4698-9d38-9e1e8c41400f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:19 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Volume volume-6edf91d8-0056-444f-bcb6-dae4e81d32ab (6edf91d8-0056-444f-bcb6-dae4e81d32ab): created successfully Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7404bb73-48be-4698-9d38-9e1e8c41400f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Flow 'volume_create_manager' (495b1766-2d91-4ef6-bb50-4a3fa5f6f49b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:19 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-84e791f3-f7a4-4193-9e97-43326a655b0a tempest-VolumesActionsTest-185324529 None] Created volume successfully. Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "cinder-quobyte-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:19 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.327s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:22:19 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] Deleted volume successfully. Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c" acquired by "delete_volume" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-02b2d3d3-77fe-4021-aa2b-b6dc7ef741fc tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-2e5dcda5-3ae7-41d2-9afe-51180ef5a9f8-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7301491d-0c9a-45ee-a5dc-56cb2f5a6535]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:19 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c Jul 14 21:22:19 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Flow 'volume_create_manager' (e9e6c594-23d6-4471-9dda-dfa5228e19b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff47bcb-796f-490c-99ae-765c16124aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff47bcb-796f-490c-99ae-765c16124aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1545872344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0e76b3-aab1-4c3b-b63f-a1e44731418d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee19da466244af5a425b5f445ab3624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:20Z,use_quota=True,user_id='1c69ce710c2e4e3d8e56217921305dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:20 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b98eddd-276d-4a87-81ed-e16a6d7ee9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b98eddd-276d-4a87-81ed-e16a6d7ee9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d313c7-3982-485d-9f63-a6a88d117dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d313c7-3982-485d-9f63-a6a88d117dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b0e76b3-aab1-4c3b-b63f-a1e44731418d', 'volume_name': 'volume-3b0e76b3-aab1-4c3b-b63f-a1e44731418d', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143981cc-d44d-48da-824b-cc531c68ed64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143981cc-d44d-48da-824b-cc531c68ed64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758b483e-3b73-4c34-b11c-e6a53411bae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:20 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Volume 3b0e76b3-aab1-4c3b-b63f-a1e44731418d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b0e76b3-aab1-4c3b-b63f-a1e44731418d', 'volume_size': 1} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1545872344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0e76b3-aab1-4c3b-b63f-a1e44731418d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee19da466244af5a425b5f445ab3624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:20Z,use_quota=True,user_id='1c69ce710c2e4e3d8e56217921305dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Creating volume 3b0e76b3-aab1-4c3b-b63f-a1e44731418d {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:22:20 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b0e76b3-aab1-4c3b-b63f-a1e44731418d 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c" returned: 0 in 0.521s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:20 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b0e76b3-aab1-4c3b-b63f-a1e44731418d 1073741824 Jul 14 21:22:20 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:20 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c Jul 14 21:22:20 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:20 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c" returned: 0 in 0.293s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-quobyte-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c" released by "delete_volume" :: held 0.894s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] Acquiring lock "cinder-6edf91d8-0056-444f-bcb6-dae4e81d32ab-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] Lock "cinder-6edf91d8-0056-444f-bcb6-dae4e81d32ab-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] Created reservations ['e43dc3ec-501f-4189-a150-4e0b327ff657', 'ef04408f-ed70-4d05-a914-7d372b0051cf', '2465ecfc-dc0e-43d6-9bb3-1109fa9d93d6', '996b0239-358e-435a-a2b7-8480720b1b8a'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] Acquiring lock "cinder-quobyte-6edf91d8-0056-444f-bcb6-dae4e81d32ab" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] Lock "cinder-quobyte-6edf91d8-0056-444f-bcb6-dae4e81d32ab" acquired by "delete_volume" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2cef13-d952-428e-a7ba-c9514a20942a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6edf91d8-0056-444f-bcb6-dae4e81d32ab {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:20 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:22:20 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:20 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b0e76b3-aab1-4c3b-b63f-a1e44731418d 1073741824" returned: 0 in 0.657s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:20 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6edf91d8-0056-444f-bcb6-dae4e81d32ab Jul 14 21:22:20 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b0e76b3-aab1-4c3b-b63f-a1e44731418d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:21 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b0e76b3-aab1-4c3b-b63f-a1e44731418d Jul 14 21:22:21 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:21 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.315s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:22:21 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] Deleted volume successfully. Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-849c63df-9921-41ba-bdf1-1a48dcb3fffb tempest-VolumesSnapshotTestJSON-999933281 None] Lock "cinder-5fe93ffe-ab05-4c1f-b230-2f95fdf5976c-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:21 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6edf91d8-0056-444f-bcb6-dae4e81d32ab" returned: 0 in 0.494s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6edf91d8-0056-444f-bcb6-dae4e81d32ab {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:21 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b0e76b3-aab1-4c3b-b63f-a1e44731418d" returned: 0 in 0.334s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:21 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6edf91d8-0056-444f-bcb6-dae4e81d32ab Jul 14 21:22:21 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758b483e-3b73-4c34-b11c-e6a53411bae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b0e76b3-aab1-4c3b-b63f-a1e44731418d', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e86d3a2-74e7-4fa0-9385-d4a05ecd3d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:21 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Volume volume-3b0e76b3-aab1-4c3b-b63f-a1e44731418d (3b0e76b3-aab1-4c3b-b63f-a1e44731418d): created successfully Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e86d3a2-74e7-4fa0-9385-d4a05ecd3d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Flow 'volume_create_manager' (e9e6c594-23d6-4471-9dda-dfa5228e19b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:21 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-30cb87b2-86c8-440f-8dfc-4ab42fc8e07f tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Created volume successfully. Jul 14 21:22:21 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6edf91d8-0056-444f-bcb6-dae4e81d32ab" returned: 0 in 0.258s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] Lock "cinder-quobyte-6edf91d8-0056-444f-bcb6-dae4e81d32ab" released by "delete_volume" :: held 0.800s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] Created reservations ['5e41f01c-6eac-4480-bafb-6ee2faea9e61', 'e5385504-8689-4ab3-a454-68cff3c11050', 'f0341072-603b-4bca-b3d9-e6c18b57b7cc', '0e68dc07-e585-449f-97f2-da0d23fadc11'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:21 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:22:21 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:22 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.286s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:22:22 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] Deleted volume successfully. Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-53674f87-accc-4019-b577-961e3d36b476 tempest-VolumesActionsTest-103619004 None] Lock "cinder-6edf91d8-0056-444f-bcb6-dae4e81d32ab-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Flow 'volume_create_manager' (342b92ee-b711-4b83-b8bf-f84ff11610d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3379bb66-a7d4-4e1b-a988-905c94f72e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3379bb66-a7d4-4e1b-a988-905c94f72e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-107654498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66248a85-345a-4473-875b-dc50a282a7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164b725a54404897a8174d357dc0142d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:23Z,use_quota=True,user_id='ebaa3f93fcb84ac1836eb21c6d6e282a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7864591d-7b8b-42a1-8d51-780ade0f93d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7864591d-7b8b-42a1-8d51-780ade0f93d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff552a75-d958-4135-b9b6-cf551d2c8b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff552a75-d958-4135-b9b6-cf551d2c8b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66248a85-345a-4473-875b-dc50a282a7b0', 'volume_name': 'volume-66248a85-345a-4473-875b-dc50a282a7b0', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93ac7e9-4b36-471f-9e35-3ff340a2bc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93ac7e9-4b36-471f-9e35-3ff340a2bc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5da91a-902c-4212-9bac-297cc82fb99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:22 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Volume 66248a85-345a-4473-875b-dc50a282a7b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66248a85-345a-4473-875b-dc50a282a7b0', 'volume_size': 1} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-107654498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66248a85-345a-4473-875b-dc50a282a7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164b725a54404897a8174d357dc0142d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:23Z,use_quota=True,user_id='ebaa3f93fcb84ac1836eb21c6d6e282a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Creating volume 66248a85-345a-4473-875b-dc50a282a7b0 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:22:22 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:22:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-66248a85-345a-4473-875b-dc50a282a7b0 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:22 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-66248a85-345a-4473-875b-dc50a282a7b0 1073741824 Jul 14 21:22:22 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:23 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-66248a85-345a-4473-875b-dc50a282a7b0 1073741824" returned: 0 in 0.669s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-66248a85-345a-4473-875b-dc50a282a7b0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:23 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-66248a85-345a-4473-875b-dc50a282a7b0 Jul 14 21:22:23 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:23 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Acquiring lock "cinder-3b0e76b3-aab1-4c3b-b63f-a1e44731418d-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:23 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Lock "cinder-3b0e76b3-aab1-4c3b-b63f-a1e44731418d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:23 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Acquiring lock "cinder-quobyte-3b0e76b3-aab1-4c3b-b63f-a1e44731418d" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:23 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Lock "cinder-quobyte-3b0e76b3-aab1-4c3b-b63f-a1e44731418d" acquired by "delete_volume" :: waited 0.048s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe9be79-9527-4efa-957e-d68a0dc58019]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b0e76b3-aab1-4c3b-b63f-a1e44731418d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:24 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-66248a85-345a-4473-875b-dc50a282a7b0" returned: 0 in 0.356s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5da91a-902c-4212-9bac-297cc82fb99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66248a85-345a-4473-875b-dc50a282a7b0', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a00ba7-e96c-44b4-9377-d1c1f4bb2990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:24 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Volume volume-66248a85-345a-4473-875b-dc50a282a7b0 (66248a85-345a-4473-875b-dc50a282a7b0): created successfully Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a00ba7-e96c-44b4-9377-d1c1f4bb2990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Flow 'volume_create_manager' (342b92ee-b711-4b83-b8bf-f84ff11610d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:24 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f3a732c7-3688-4b1a-b525-cc3ae44f5517 tempest-VolumesActionsTest-185324529 None] Created volume successfully. Jul 14 21:22:24 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b0e76b3-aab1-4c3b-b63f-a1e44731418d Jul 14 21:22:24 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:24 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b0e76b3-aab1-4c3b-b63f-a1e44731418d" returned: 0 in 0.378s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b0e76b3-aab1-4c3b-b63f-a1e44731418d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:24 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b0e76b3-aab1-4c3b-b63f-a1e44731418d Jul 14 21:22:24 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:24 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3b0e76b3-aab1-4c3b-b63f-a1e44731418d" returned: 0 in 0.253s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Lock "cinder-quobyte-3b0e76b3-aab1-4c3b-b63f-a1e44731418d" released by "delete_volume" :: held 0.689s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Created reservations ['36baacd8-08ee-4d75-a04c-927706881e22', '1c7a518a-b89d-4a84-bde1-e5f78d14c201', 'd3a55275-66e9-4dc7-b4d9-94e4067de1c5', '0a14ccca-9bb9-4cce-abf1-00d0a5df94bb'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:24 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:22:24 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] Acquiring lock "cinder-66248a85-345a-4473-875b-dc50a282a7b0-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] Lock "cinder-66248a85-345a-4473-875b-dc50a282a7b0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] Acquiring lock "cinder-quobyte-66248a85-345a-4473-875b-dc50a282a7b0" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] Lock "cinder-quobyte-66248a85-345a-4473-875b-dc50a282a7b0" acquired by "delete_volume" :: waited 0.016s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:25 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.344s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:25 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:22:25 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Deleted volume successfully. Jul 14 21:22:25 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa5139d-5dc9-4363-977c-603f22f59cd6]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-66248a85-345a-4473-875b-dc50a282a7b0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a6538b74-8bc9-429f-b5ae-82c163c8658d tempest-VolumeQuotasNegativeTestJSON-1999746698 None] Lock "cinder-3b0e76b3-aab1-4c3b-b63f-a1e44731418d-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:25 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-66248a85-345a-4473-875b-dc50a282a7b0 Jul 14 21:22:25 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:25 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-66248a85-345a-4473-875b-dc50a282a7b0" returned: 0 in 0.509s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-66248a85-345a-4473-875b-dc50a282a7b0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:25 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-66248a85-345a-4473-875b-dc50a282a7b0 Jul 14 21:22:25 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:26 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-66248a85-345a-4473-875b-dc50a282a7b0" returned: 0 in 0.325s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:26 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] Lock "cinder-quobyte-66248a85-345a-4473-875b-dc50a282a7b0" released by "delete_volume" :: held 0.906s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:26 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] Created reservations ['a4ef758b-a609-4294-ad45-0522078f3b7c', 'fc4d2571-106f-44d8-beeb-cbabad56e078', '8efc0d09-dfd9-45c3-8628-b25a237a9afa', '51ebcbda-4cf7-4466-82a7-be642dde40b0'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:22:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:26 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:26 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:26 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:22:26 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:26 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.359s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:26 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:22:26 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] Deleted volume successfully. Jul 14 21:22:26 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc599c3c-6d87-4351-b5d9-da7064e56604 tempest-VolumesActionsTest-103619004 None] Lock "cinder-66248a85-345a-4473-875b-dc50a282a7b0-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Flow 'volume_create_manager' (2c1c6d9d-4a69-4f11-b5da-2b54311f214f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6406db1a-37b4-41bf-9340-0b985cc3cf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6406db1a-37b4-41bf-9340-0b985cc3cf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2121196245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14f1c2c-1b14-46b2-87ce-6a2036cd79ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164b725a54404897a8174d357dc0142d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:28Z,use_quota=True,user_id='ebaa3f93fcb84ac1836eb21c6d6e282a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8996ee4-2e8d-4d92-8123-02a51dbaa5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8996ee4-2e8d-4d92-8123-02a51dbaa5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86516f76-91cb-4568-96e3-766c2a9baa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86516f76-91cb-4568-96e3-766c2a9baa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e14f1c2c-1b14-46b2-87ce-6a2036cd79ae', 'volume_name': 'volume-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6b6dc8-8704-4fec-997a-62d4d9183eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6b6dc8-8704-4fec-997a-62d4d9183eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49934884-bb57-4086-be6b-16fbf902a25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:27 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Volume e14f1c2c-1b14-46b2-87ce-6a2036cd79ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae', 'volume_size': 1} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2121196245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14f1c2c-1b14-46b2-87ce-6a2036cd79ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164b725a54404897a8174d357dc0142d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:28Z,use_quota=True,user_id='ebaa3f93fcb84ac1836eb21c6d6e282a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Creating volume e14f1c2c-1b14-46b2-87ce-6a2036cd79ae {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:22:27 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:22:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:28 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae 1073741824 Jul 14 21:22:28 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:28 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae 1073741824" returned: 0 in 0.525s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:28 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae Jul 14 21:22:28 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:28 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae" returned: 0 in 0.277s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:28 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:22:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49934884-bb57-4086-be6b-16fbf902a25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69b4c1e-e2df-47c1-98bb-07eca72b213a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:28 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Volume volume-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae (e14f1c2c-1b14-46b2-87ce-6a2036cd79ae): created successfully Jul 14 21:22:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69b4c1e-e2df-47c1-98bb-07eca72b213a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Flow 'volume_create_manager' (2c1c6d9d-4a69-4f11-b5da-2b54311f214f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:28 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-b27d837e-a272-4010-8fb1-3cf2ea2de51a tempest-VolumesActionsTest-185324529 None] Created volume successfully. Jul 14 21:22:30 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] Acquiring lock "cinder-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:30 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] Lock "cinder-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:30 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] Acquiring lock "cinder-quobyte-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:30 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] Lock "cinder-quobyte-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae" acquired by "delete_volume" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:30 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[154e877c-38ea-4b19-a9b3-3900406bcc0f]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:31 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae Jul 14 21:22:31 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Flow 'volume_create_manager' (46eb397d-3ccd-4a6a-b54c-b80b756513bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:31 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2821c495-a54c-48f3-9831-cecfb80cc552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae" returned: 0 in 0.726s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2821c495-a54c-48f3-9831-cecfb80cc552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1907862274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f20b1221-231f-46ad-8c3a-bce5621b92fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44015d66e48146bd966016a3fbd6b857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:32Z,use_quota=True,user_id='93029e4baa774ad4a7755fbc29255c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88574b98-d9dc-43d0-8b04-58c68483594f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:31 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae Jul 14 21:22:31 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88574b98-d9dc-43d0-8b04-58c68483594f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139857f1-ab73-45b1-a679-762824379d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139857f1-ab73-45b1-a679-762824379d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f20b1221-231f-46ad-8c3a-bce5621b92fd', 'volume_name': 'volume-f20b1221-231f-46ad-8c3a-bce5621b92fd', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b823c553-e36d-451a-92e7-e3fc0dd477bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b823c553-e36d-451a-92e7-e3fc0dd477bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc100921-aea3-4773-a6b0-536ed3b6f88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:31 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Volume f20b1221-231f-46ad-8c3a-bce5621b92fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f20b1221-231f-46ad-8c3a-bce5621b92fd', 'volume_size': 1} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1907862274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f20b1221-231f-46ad-8c3a-bce5621b92fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44015d66e48146bd966016a3fbd6b857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:32Z,use_quota=True,user_id='93029e4baa774ad4a7755fbc29255c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Creating volume f20b1221-231f-46ad-8c3a-bce5621b92fd {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:22:31 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:22:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f20b1221-231f-46ad-8c3a-bce5621b92fd 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:31 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f20b1221-231f-46ad-8c3a-bce5621b92fd 1073741824 Jul 14 21:22:31 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:32 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae" returned: 0 in 0.421s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] Lock "cinder-quobyte-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae" released by "delete_volume" :: held 1.209s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] Created reservations ['f13d89c5-d4e7-4110-8c8f-84f9a1784228', '5288c8f7-d611-4393-ae32-ea8cc2d69e33', '30a48a23-22df-47c2-ac18-7cd7697d4e23', '81f98726-0dae-4b6a-8878-df485f199643'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:32 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:22:32 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:32 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f20b1221-231f-46ad-8c3a-bce5621b92fd 1073741824" returned: 0 in 0.739s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f20b1221-231f-46ad-8c3a-bce5621b92fd {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:32 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f20b1221-231f-46ad-8c3a-bce5621b92fd Jul 14 21:22:32 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:32 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.322s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:22:32 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] Deleted volume successfully. Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2e659c87-7dd5-4606-a0b3-ee4d93d4bfd5 tempest-VolumesActionsTest-185324529 None] Lock "cinder-e14f1c2c-1b14-46b2-87ce-6a2036cd79ae-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:32 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f20b1221-231f-46ad-8c3a-bce5621b92fd" returned: 0 in 0.348s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc100921-aea3-4773-a6b0-536ed3b6f88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f20b1221-231f-46ad-8c3a-bce5621b92fd', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f30254-f469-4361-8ba4-38419c01ebcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:32 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Volume volume-f20b1221-231f-46ad-8c3a-bce5621b92fd (f20b1221-231f-46ad-8c3a-bce5621b92fd): created successfully Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f30254-f469-4361-8ba4-38419c01ebcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Flow 'volume_create_manager' (46eb397d-3ccd-4a6a-b54c-b80b756513bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:32 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-7bf7e07c-be3e-40da-bb67-adfd72bd4fd1 tempest-AbsoluteLimitsTests-246387162 None] Created volume successfully. Jul 14 21:22:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] Acquiring lock "cinder-f20b1221-231f-46ad-8c3a-bce5621b92fd-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] Lock "cinder-f20b1221-231f-46ad-8c3a-bce5621b92fd-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] Acquiring lock "cinder-quobyte-f20b1221-231f-46ad-8c3a-bce5621b92fd" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] Lock "cinder-quobyte-f20b1221-231f-46ad-8c3a-bce5621b92fd" acquired by "delete_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:33 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ad478d-099c-4d79-9598-71745845132d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f20b1221-231f-46ad-8c3a-bce5621b92fd {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:34 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f20b1221-231f-46ad-8c3a-bce5621b92fd Jul 14 21:22:34 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:34 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f20b1221-231f-46ad-8c3a-bce5621b92fd" returned: 0 in 0.664s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f20b1221-231f-46ad-8c3a-bce5621b92fd {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:34 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f20b1221-231f-46ad-8c3a-bce5621b92fd Jul 14 21:22:34 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:34 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:22:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Flow 'volume_create_manager' (2bfdb951-68bf-4bdc-a16e-0371b41e5417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281e13d2-b97b-4a04-88bb-b677cf3a36df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281e13d2-b97b-4a04-88bb-b677cf3a36df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-500035935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c964b86-26b9-4421-a07e-4b1318a01712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e3ec1e91424dd694bf6009f3672b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:35Z,use_quota=True,user_id='34f199c456d64f4cb2d1deb4011e6abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f5618e-16f9-42fe-8920-7b74f30602df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f5618e-16f9-42fe-8920-7b74f30602df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2917fb7-f217-407e-b9fc-f4937dd44aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2917fb7-f217-407e-b9fc-f4937dd44aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c964b86-26b9-4421-a07e-4b1318a01712', 'volume_name': 'volume-1c964b86-26b9-4421-a07e-4b1318a01712', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83bd261f-2c12-40fa-a1c7-38101f152720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83bd261f-2c12-40fa-a1c7-38101f152720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1693b57d-03fb-46f2-93ce-887213fcb057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:35 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Volume 1c964b86-26b9-4421-a07e-4b1318a01712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c964b86-26b9-4421-a07e-4b1318a01712', 'volume_size': 1} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-500035935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c964b86-26b9-4421-a07e-4b1318a01712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e3ec1e91424dd694bf6009f3672b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:35Z,use_quota=True,user_id='34f199c456d64f4cb2d1deb4011e6abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Creating volume 1c964b86-26b9-4421-a07e-4b1318a01712 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:22:35 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:35 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1c964b86-26b9-4421-a07e-4b1318a01712 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f20b1221-231f-46ad-8c3a-bce5621b92fd" returned: 0 in 0.388s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] Lock "cinder-quobyte-f20b1221-231f-46ad-8c3a-bce5621b92fd" released by "delete_volume" :: held 1.125s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:35 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1c964b86-26b9-4421-a07e-4b1318a01712 1073741824 Jul 14 21:22:35 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] Created reservations ['2a38f8e6-0310-44b9-bd57-6ad208a7c3e0', '26623112-8a5e-4070-8d8a-d4ac8a8865b1', '9c56a0f6-b71a-4913-9502-49c332e023f9', 'd6fe3537-2806-4c36-bd6e-137ab188603f'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:35 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:22:35 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:35 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.360s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:22:35 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] Deleted volume successfully. Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e7dd84ec-d0d9-4194-8199-d8f6a913b2fd tempest-AbsoluteLimitsTests-246387162 None] Lock "cinder-f20b1221-231f-46ad-8c3a-bce5621b92fd-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:35 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1c964b86-26b9-4421-a07e-4b1318a01712 1073741824" returned: 0 in 0.649s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1c964b86-26b9-4421-a07e-4b1318a01712 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:35 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1c964b86-26b9-4421-a07e-4b1318a01712 Jul 14 21:22:35 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:36 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1c964b86-26b9-4421-a07e-4b1318a01712" returned: 0 in 0.286s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:22:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1693b57d-03fb-46f2-93ce-887213fcb057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c964b86-26b9-4421-a07e-4b1318a01712', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9facc62-a4ad-4809-818d-c4d1182dd8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:36 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Volume volume-1c964b86-26b9-4421-a07e-4b1318a01712 (1c964b86-26b9-4421-a07e-4b1318a01712): created successfully Jul 14 21:22:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9facc62-a4ad-4809-818d-c4d1182dd8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Flow 'volume_create_manager' (2bfdb951-68bf-4bdc-a16e-0371b41e5417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:36 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a2daa683-2095-498e-aadb-e0fae19952b8 tempest-AttachVolumeNegativeTest-850271826 None] Created volume successfully. Jul 14 21:22:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:22:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:36 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:22:36 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:37 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.454s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:37 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:22:37 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:22:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 28 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:22:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:22:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-1827c201-a726-4eb2-88de-1c99423582b5 req-4a4989d0-d3c8-4111-b8b8-9db62b3aede0 tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-1827c201-a726-4eb2-88de-1c99423582b5 req-4a4989d0-d3c8-4111-b8b8-9db62b3aede0 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:38 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[27953590-8175-4edc-9f0a-0fa51a5e40be]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-1827c201-a726-4eb2-88de-1c99423582b5 req-4a4989d0-d3c8-4111-b8b8-9db62b3aede0 tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1c964b86-26b9-4421-a07e-4b1318a01712 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:38 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1c964b86-26b9-4421-a07e-4b1318a01712 Jul 14 21:22:38 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:38 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-1827c201-a726-4eb2-88de-1c99423582b5 req-4a4989d0-d3c8-4111-b8b8-9db62b3aede0 tempest-AttachVolumeNegativeTest-850271826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1c964b86-26b9-4421-a07e-4b1318a01712" returned: 0 in 0.425s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-1827c201-a726-4eb2-88de-1c99423582b5 req-4a4989d0-d3c8-4111-b8b8-9db62b3aede0 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.453s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-1827c201-a726-4eb2-88de-1c99423582b5 req-4a4989d0-d3c8-4111-b8b8-9db62b3aede0 tempest-AttachVolumeNegativeTest-850271826 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-1c964b86-26b9-4421-a07e-4b1318a01712', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a283c8b7-5870-40b0-9e8b-90754afb8f2a', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:22:38 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-1827c201-a726-4eb2-88de-1c99423582b5 req-4a4989d0-d3c8-4111-b8b8-9db62b3aede0 tempest-AttachVolumeNegativeTest-850271826 None] attachment_update completed successfully. Jul 14 21:22:41 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-6d482608-26ab-4e1e-8d18-4da3be0b2cd3 req-4df7353f-42a7-47f7-8e79-4cc88a770c8a tempest-AttachVolumeNegativeTest-850271826 None] Terminate volume connection completed successfully. Jul 14 21:22:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-6d482608-26ab-4e1e-8d18-4da3be0b2cd3 req-4df7353f-42a7-47f7-8e79-4cc88a770c8a tempest-AttachVolumeNegativeTest-850271826 None] Deleting attachment a283c8b7-5870-40b0-9e8b-90754afb8f2a. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Flow 'volume_create_manager' (3b755d82-a908-4726-95b1-5e02926a21b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76292950-ce1e-49f9-bba1-443272b4b6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76292950-ce1e-49f9-bba1-443272b4b6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-212607455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac27738da504480988a205e80130f571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:44Z,use_quota=True,user_id='553eb6dfe0d9471dac7105b87d786fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfb113b-a730-4a68-adba-fad70c9c4227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfb113b-a730-4a68-adba-fad70c9c4227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228c2c19-93df-4424-8582-05656276f7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228c2c19-93df-4424-8582-05656276f7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9', 'volume_name': 'volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff67c7c7-1d17-43f1-b859-ea47e8573e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff67c7c7-1d17-43f1-b859-ea47e8573e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccd5f61-f548-40df-afba-1aeff6b41c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:44 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Volume 34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9', 'volume_size': 1} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-212607455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac27738da504480988a205e80130f571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:44Z,use_quota=True,user_id='553eb6dfe0d9471dac7105b87d786fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Creating volume 34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:22:44 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:44 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 1073741824 Jul 14 21:22:44 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:44 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 1073741824" returned: 0 in 0.527s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:44 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 Jul 14 21:22:44 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:45 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9" returned: 0 in 0.357s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:45 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:22:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccd5f61-f548-40df-afba-1aeff6b41c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92abac30-5039-4c4a-9781-20977241b4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:45 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Volume volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 (34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9): created successfully Jul 14 21:22:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92abac30-5039-4c4a-9781-20977241b4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Flow 'volume_create_manager' (3b755d82-a908-4726-95b1-5e02926a21b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:45 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-885036ff-88a2-482d-92c0-181c2062529d tempest-VolumesDeleteCascade-1337992431 None] Created volume successfully. Jul 14 21:22:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:46 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] Creating offline snapshot 44bd39ef-3f07-400d-8815-52139d8bb089 of volume 34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:22:46 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a156c6f-9c4c-4655-8a72-212b4668d899]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:46 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 Jul 14 21:22:46 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:47 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9" returned: 0 in 0.441s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:47 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 1G Jul 14 21:22:47 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:47 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 1G" returned: 0 in 0.607s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:47 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 Jul 14 21:22:47 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:48 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089" returned: 0 in 0.364s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:48 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 is being set with open permissions: ugo+rw Jul 14 21:22:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:48 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 Jul 14 21:22:48 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:48 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089" returned: 0 in 0.280s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:48 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.info Jul 14 21:22:48 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:48 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.info" returned: 0 in 0.312s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:48 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.info is being set with open permissions: ugo+rw Jul 14 21:22:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:48 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.info Jul 14 21:22:48 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:48 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.info" returned: 0 in 0.276s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.437s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:49 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-cb828e8e-74ca-4fb8-b6c9-d15cf30cab59 tempest-VolumesDeleteCascade-1337992431 None] Create snapshot completed successfully Jul 14 21:22:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-88582bed-c835-406a-815f-0def4fd342e6 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-88582bed-c835-406a-815f-0def4fd342e6 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-88582bed-c835-406a-815f-0def4fd342e6 tempest-VolumesDeleteCascade-1337992431 None] Creating offline snapshot effc3004-3fa1-484e-bf39-141650868a76 of volume 34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:22:50 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae002450-fc56-4b07-8c26-45ad7ad9b171]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-88582bed-c835-406a-815f-0def4fd342e6 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:50 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 Jul 14 21:22:50 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:50 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-88582bed-c835-406a-815f-0def4fd342e6 tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089" returned: 0 in 0.540s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-88582bed-c835-406a-815f-0def4fd342e6 tempest-VolumesDeleteCascade-1337992431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:22:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-88582bed-c835-406a-815f-0def4fd342e6 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:50 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 1G Jul 14 21:22:50 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:51 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-88582bed-c835-406a-815f-0def4fd342e6 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 1G" returned: 0 in 0.648s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-88582bed-c835-406a-815f-0def4fd342e6 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:51 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 Jul 14 21:22:51 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:51 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-88582bed-c835-406a-815f-0def4fd342e6 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76" returned: 0 in 0.495s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:51 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-88582bed-c835-406a-815f-0def4fd342e6 tempest-VolumesDeleteCascade-1337992431 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 is being set with open permissions: ugo+rw Jul 14 21:22:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-88582bed-c835-406a-815f-0def4fd342e6 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:51 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 Jul 14 21:22:51 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:52 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-88582bed-c835-406a-815f-0def4fd342e6 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76" returned: 0 in 0.335s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-88582bed-c835-406a-815f-0def4fd342e6 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:52 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-88582bed-c835-406a-815f-0def4fd342e6 tempest-VolumesDeleteCascade-1337992431 None] Create snapshot completed successfully Jul 14 21:22:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "cinder-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Performing cascade delete. {{(pid=88300) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 14 21:22:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "cinder-44bd39ef-3f07-400d-8815-52139d8bb089-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-44bd39ef-3f07-400d-8815-52139d8bb089-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "cinder-quobyte-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "cinder-quobyte-44bd39ef-3f07-400d-8815-52139d8bb089" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-44bd39ef-3f07-400d-8815-52139d8bb089" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Deleting offline snapshot 44bd39ef-3f07-400d-8815-52139d8bb089 of volume 34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:22:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] snapshot_file for this snap is: volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:22:53 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb202002-7be4-4283-86d5-ba305a325b3d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:53 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 Jul 14 21:22:53 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:53 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089" returned: 0 in 0.482s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:22:53 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[80af6908-6efe-441e-8642-2eb8996aa4ac]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Flow 'volume_create_manager' (261dee27-f25e-4cbf-b50d-8456e56c1b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:54 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 Jul 14 21:22:54 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98e2884-8657-464c-81c5-744c0a2a66d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98e2884-8657-464c-81c5-744c0a2a66d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2039379302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc381acd-bb1b-47ea-b930-e68995bae327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d375313e5e4ab285c48181af5bbf5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:54Z,use_quota=True,user_id='543dcebcf765458988238dc00086ca31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7747cf3-6586-412d-960c-89ba2fc0c1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7747cf3-6586-412d-960c-89ba2fc0c1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d92f967-8036-4bbe-acb9-4a6d18678eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d92f967-8036-4bbe-acb9-4a6d18678eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc381acd-bb1b-47ea-b930-e68995bae327', 'volume_name': 'volume-fc381acd-bb1b-47ea-b930-e68995bae327', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba950b6e-42ab-40cb-8a26-00f07abf9e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba950b6e-42ab-40cb-8a26-00f07abf9e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c45632-afea-432f-a181-08c058bdb446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:54 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Volume fc381acd-bb1b-47ea-b930-e68995bae327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc381acd-bb1b-47ea-b930-e68995bae327', 'volume_size': 1} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2039379302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc381acd-bb1b-47ea-b930-e68995bae327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d375313e5e4ab285c48181af5bbf5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:54Z,use_quota=True,user_id='543dcebcf765458988238dc00086ca31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Creating volume fc381acd-bb1b-47ea-b930-e68995bae327 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:22:54 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fc381acd-bb1b-47ea-b930-e68995bae327 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:54 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fc381acd-bb1b-47ea-b930-e68995bae327 1073741824 Jul 14 21:22:54 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:54 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9" returned: 0 in 0.650s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0842b8-e18a-4d9d-91bd-cc5fae2e6255]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:54 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 Jul 14 21:22:54 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:54 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fc381acd-bb1b-47ea-b930-e68995bae327 1073741824" returned: 0 in 0.641s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fc381acd-bb1b-47ea-b930-e68995bae327 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:55 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fc381acd-bb1b-47ea-b930-e68995bae327 Jul 14 21:22:55 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:55 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76" returned: 0 in 0.543s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:55 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:22:55 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a690b8f0-9980-4de3-b458-16e6e5fe5f83]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:55 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fc381acd-bb1b-47ea-b930-e68995bae327" returned: 0 in 0.359s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:55 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:22:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c45632-afea-432f-a181-08c058bdb446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc381acd-bb1b-47ea-b930-e68995bae327', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c819f3ab-fe43-4371-8dec-1733570e902f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:55 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Volume volume-fc381acd-bb1b-47ea-b930-e68995bae327 (fc381acd-bb1b-47ea-b930-e68995bae327): created successfully Jul 14 21:22:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c819f3ab-fe43-4371-8dec-1733570e902f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:55 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 Jul 14 21:22:55 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Flow 'volume_create_manager' (261dee27-f25e-4cbf-b50d-8456e56c1b6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:55 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0d1e1c08-6a11-4b96-93e5-1aa2eb6df0cb tempest-VolumesListAdminTestJSON-1158580553 None] Created volume successfully. Jul 14 21:22:55 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089" returned: 0 in 0.622s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:55 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:22:55 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c79f74e-dd2c-425c-8190-859c5e58d701]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:56 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 Jul 14 21:22:56 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:56 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9" returned: 0 in 0.440s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:56 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 Jul 14 21:22:56 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:57 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089" returned: 0 in 0.759s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:57 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089 Jul 14 21:22:57 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Flow 'volume_create_manager' (dc3cfd60-0059-4a56-9216-6241d22d6a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884a3c35-af53-46c6-99b8-8c1353995cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884a3c35-af53-46c6-99b8-8c1353995cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2131367140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feee12fa-7786-47d9-b8ee-27254f91ad94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d375313e5e4ab285c48181af5bbf5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:57Z,use_quota=True,user_id='543dcebcf765458988238dc00086ca31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (268b60c8-4af4-41e9-816d-2ab3c9f61f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (268b60c8-4af4-41e9-816d-2ab3c9f61f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9b635e-bea4-488f-bb8d-193f351d1fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9b635e-bea4-488f-bb8d-193f351d1fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feee12fa-7786-47d9-b8ee-27254f91ad94', 'volume_name': 'volume-feee12fa-7786-47d9-b8ee-27254f91ad94', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a4015b-d842-43fe-9ac8-80e016a22a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a4015b-d842-43fe-9ac8-80e016a22a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df880362-58ee-4d2a-bfca-0811e1fd36f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:57 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Volume feee12fa-7786-47d9-b8ee-27254f91ad94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feee12fa-7786-47d9-b8ee-27254f91ad94', 'volume_size': 1} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2131367140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feee12fa-7786-47d9-b8ee-27254f91ad94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d375313e5e4ab285c48181af5bbf5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:22:57Z,use_quota=True,user_id='543dcebcf765458988238dc00086ca31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Creating volume feee12fa-7786-47d9-b8ee-27254f91ad94 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:22:57 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:22:57 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-feee12fa-7786-47d9-b8ee-27254f91ad94 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.44bd39ef-3f07-400d-8815-52139d8bb089" returned: 0 in 0.462s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 -F qcow2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:57 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-feee12fa-7786-47d9-b8ee-27254f91ad94 1073741824 Jul 14 21:22:57 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:57 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 -F qcow2 Jul 14 21:22:57 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:58 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 -F qcow2" returned: 0 in 0.451s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-44bd39ef-3f07-400d-8815-52139d8bb089" released by "_delete_snapshot" :: held 4.646s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9" released by "delete_snapshot" :: held 4.678s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:58 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-feee12fa-7786-47d9-b8ee-27254f91ad94 1073741824" returned: 0 in 0.574s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-feee12fa-7786-47d9-b8ee-27254f91ad94 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Created reservations ['581c6d7d-9dc6-405a-9f8f-6840dc926a54', '78274e89-33d2-4662-9e9e-86739a5467bb', '994931a0-0775-417c-a76b-c34956d87d2f', '51b07065-b0f2-44f9-bd70-cfba71d693c6'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:22:58 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-feee12fa-7786-47d9-b8ee-27254f91ad94 Jul 14 21:22:58 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:58 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Delete snapshot completed successfully. Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-44bd39ef-3f07-400d-8815-52139d8bb089-delete_snapshot" released by "delete_snapshot" :: held 4.959s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "cinder-effc3004-3fa1-484e-bf39-141650868a76-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-effc3004-3fa1-484e-bf39-141650868a76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "cinder-quobyte-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "cinder-quobyte-effc3004-3fa1-484e-bf39-141650868a76" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-effc3004-3fa1-484e-bf39-141650868a76" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Deleting offline snapshot effc3004-3fa1-484e-bf39-141650868a76 of volume 34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] snapshot_file for this snap is: volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6f379a-ba10-45b2-9e30-dc6f2a7dcbb9]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:58 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-feee12fa-7786-47d9-b8ee-27254f91ad94" returned: 0 in 0.367s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df880362-58ee-4d2a-bfca-0811e1fd36f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feee12fa-7786-47d9-b8ee-27254f91ad94', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0deb1e4f-de48-4f74-9653-3a6f8d392ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:22:58 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Volume volume-feee12fa-7786-47d9-b8ee-27254f91ad94 (feee12fa-7786-47d9-b8ee-27254f91ad94): created successfully Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0deb1e4f-de48-4f74-9653-3a6f8d392ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Flow 'volume_create_manager' (dc3cfd60-0059-4a56-9216-6241d22d6a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:22:58 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 Jul 14 21:22:58 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:58 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-4509afdd-2e1f-408d-9f95-fd1b89f7c983 tempest-VolumesListAdminTestJSON-1158580553 None] Created volume successfully. Jul 14 21:22:58 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76" returned: 0 in 0.492s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:22:59 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae3301d-2df8-47ae-a32b-4317b7b53647]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:22:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:59 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 Jul 14 21:22:59 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:22:59 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Jul 14 21:22:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9" returned: 0 in 0.552s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:22:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:22:59 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 Jul 14 21:22:59 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:00 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76" returned: 0 in 0.940s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:00 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76 Jul 14 21:23:00 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Flow 'volume_create_manager' (b2209143-a76e-48a6-afe1-0ca1168a0b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505b58c9-cfaf-4814-852d-04699b544f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (505b58c9-cfaf-4814-852d-04699b544f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-490204847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33a50a58-58ae-4955-aa5b-a3c4b17b7046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d375313e5e4ab285c48181af5bbf5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:01Z,use_quota=True,user_id='543dcebcf765458988238dc00086ca31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd54569e-c222-4a1a-b27e-1349d92bf69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd54569e-c222-4a1a-b27e-1349d92bf69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b39945-0e84-4e59-914a-fc13a263fcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b39945-0e84-4e59-914a-fc13a263fcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33a50a58-58ae-4955-aa5b-a3c4b17b7046', 'volume_name': 'volume-33a50a58-58ae-4955-aa5b-a3c4b17b7046', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aae1cab-ffdc-455b-96e4-64e7420cc2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aae1cab-ffdc-455b-96e4-64e7420cc2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e305b487-42fe-4b92-bae1-9a384c5f308d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:00 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Volume 33a50a58-58ae-4955-aa5b-a3c4b17b7046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33a50a58-58ae-4955-aa5b-a3c4b17b7046', 'volume_size': 1} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-490204847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33a50a58-58ae-4955-aa5b-a3c4b17b7046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d375313e5e4ab285c48181af5bbf5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:01Z,use_quota=True,user_id='543dcebcf765458988238dc00086ca31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Creating volume 33a50a58-58ae-4955-aa5b-a3c4b17b7046 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:23:00 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:23:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-33a50a58-58ae-4955-aa5b-a3c4b17b7046 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:00 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-33a50a58-58ae-4955-aa5b-a3c4b17b7046 1073741824 Jul 14 21:23:00 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:01 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9.effc3004-3fa1-484e-bf39-141650868a76" returned: 0 in 0.565s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-effc3004-3fa1-484e-bf39-141650868a76" released by "_delete_snapshot" :: held 2.732s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9" released by "delete_snapshot" :: held 2.764s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:01 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Created reservations ['7a29d1d1-238b-4162-bd72-87f3738fb06d', '785eb220-cfd3-4dbb-b2e8-f982a1631b87', '30b64293-2d97-4ee5-bbc8-022adaffd8c1', '06b92b99-b939-4b9f-b08a-ca69abd0a9a2'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:01 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Delete snapshot completed successfully. Jul 14 21:23:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-effc3004-3fa1-484e-bf39-141650868a76-delete_snapshot" released by "delete_snapshot" :: held 3.101s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Snapshots deleted, issuing volume delete {{(pid=88300) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 14 21:23:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "cinder-quobyte-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9" acquired by "delete_volume" :: waited 0.032s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:01 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b256e83a-2478-493e-9a54-605d3561edbe]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:01 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-33a50a58-58ae-4955-aa5b-a3c4b17b7046 1073741824" returned: 0 in 0.817s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:01 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 Jul 14 21:23:01 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-33a50a58-58ae-4955-aa5b-a3c4b17b7046 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:01 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-33a50a58-58ae-4955-aa5b-a3c4b17b7046 Jul 14 21:23:01 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:02 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9" returned: 0 in 0.675s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:02 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9 Jul 14 21:23:02 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:02 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-33a50a58-58ae-4955-aa5b-a3c4b17b7046" returned: 0 in 0.579s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e305b487-42fe-4b92-bae1-9a384c5f308d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33a50a58-58ae-4955-aa5b-a3c4b17b7046', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9d1fca-868b-479c-b69c-d4ea3635e39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:02 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Volume volume-33a50a58-58ae-4955-aa5b-a3c4b17b7046 (33a50a58-58ae-4955-aa5b-a3c4b17b7046): created successfully Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9d1fca-868b-479c-b69c-d4ea3635e39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Flow 'volume_create_manager' (b2209143-a76e-48a6-afe1-0ca1168a0b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:02 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-593124cc-8345-40f9-b059-fcd8d84d1614 tempest-VolumesListAdminTestJSON-1158580553 None] Created volume successfully. Jul 14 21:23:02 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9" returned: 0 in 0.409s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9" released by "delete_volume" :: held 1.214s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Created reservations ['a02a2e81-1ba0-4755-9627-494e8e3252df', 'd9496dc8-cdb7-452c-bce9-b14d6f449944', '57e4fe82-9749-4cec-8d0a-df8bcad1d3e0', 'd5bc0671-8307-4536-bdb7-377dfd5dbb22'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:02 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:23:02 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:03 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.296s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:23:03 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Deleted volume successfully. Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c4ce6480-b5fb-4af1-b58f-fad62c3f5738 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-34cb486a-a0ad-47f8-9f5b-2cb6ab471bc9-delete_volume" released by "delete_volume" :: held 9.964s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Flow 'volume_create_manager' (8d529bf9-d073-4d06-a109-58674b8a2142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291b5dde-277e-46bf-9bef-19d3c2780ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291b5dde-277e-46bf-9bef-19d3c2780ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb0212c-9a80-4a8e-8374-26f4b9d78ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e932eed42949ee95b4428b59b34d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:04Z,use_quota=True,user_id='1254761ed19249aead390b42f283cb2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8eb81f2-d45d-4d0e-b007-69c56b90508d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8eb81f2-d45d-4d0e-b007-69c56b90508d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100ad025-279b-44de-8285-c9158eb73831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100ad025-279b-44de-8285-c9158eb73831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffb0212c-9a80-4a8e-8374-26f4b9d78ba7', 'volume_name': 'volume-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250e154b-d89b-4d61-bead-9e2745f901d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250e154b-d89b-4d61-bead-9e2745f901d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985c0488-57f1-48ae-abc8-39e429b086ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:03 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Volume ffb0212c-9a80-4a8e-8374-26f4b9d78ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7', 'volume_size': 1} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb0212c-9a80-4a8e-8374-26f4b9d78ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e932eed42949ee95b4428b59b34d55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:04Z,use_quota=True,user_id='1254761ed19249aead390b42f283cb2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Creating volume ffb0212c-9a80-4a8e-8374-26f4b9d78ba7 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:23:03 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:23:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:03 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7 1073741824 Jul 14 21:23:03 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:04 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7 1073741824" returned: 0 in 0.872s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:04 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:23:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Flow 'volume_create_manager' (1bcf3932-14fb-4ee9-af82-6e0c17395ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902f306c-42ea-45b8-8322-41b33ee7561b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902f306c-42ea-45b8-8322-41b33ee7561b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-474157816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96b347f-94dc-4f63-a82b-4cebf54bd851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac27738da504480988a205e80130f571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:05Z,use_quota=True,user_id='553eb6dfe0d9471dac7105b87d786fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81b6c71-5633-4826-9d96-670c7fcd5f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81b6c71-5633-4826-9d96-670c7fcd5f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5d9455-5e4a-4377-b032-b81008157341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5d9455-5e4a-4377-b032-b81008157341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e96b347f-94dc-4f63-a82b-4cebf54bd851', 'volume_name': 'volume-e96b347f-94dc-4f63-a82b-4cebf54bd851', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2ce214-bc05-4332-81fe-bc26fdca1031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2ce214-bc05-4332-81fe-bc26fdca1031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f697d7b9-6840-4df5-bc12-4de5e083d400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:04 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Volume e96b347f-94dc-4f63-a82b-4cebf54bd851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e96b347f-94dc-4f63-a82b-4cebf54bd851', 'volume_size': 1} Jul 14 21:23:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:04 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7 Jul 14 21:23:04 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:05 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7" returned: 0 in 0.375s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:23:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.314s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-474157816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96b347f-94dc-4f63-a82b-4cebf54bd851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac27738da504480988a205e80130f571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:05Z,use_quota=True,user_id='553eb6dfe0d9471dac7105b87d786fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:23:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Creating volume e96b347f-94dc-4f63-a82b-4cebf54bd851 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:23:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:23:05 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:23:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:05 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 1073741824 Jul 14 21:23:05 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985c0488-57f1-48ae-abc8-39e429b086ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767b142e-cc56-4584-9d9e-b10b2624a081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:05 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Volume volume-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7 (ffb0212c-9a80-4a8e-8374-26f4b9d78ba7): created successfully Jul 14 21:23:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767b142e-cc56-4584-9d9e-b10b2624a081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Flow 'volume_create_manager' (8d529bf9-d073-4d06-a109-58674b8a2142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:05 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-90c25355-3f9c-4ae8-840f-9631eeddd30f tempest-VolumesListAdminTestJSON-915588992 None] Created volume successfully. Jul 14 21:23:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] Acquiring lock "cinder-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] Lock "cinder-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:06 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 1073741824" returned: 0 in 0.888s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] Acquiring lock "cinder-quobyte-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] Lock "cinder-quobyte-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7" acquired by "delete_volume" :: waited 0.060s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:06 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8423ca-2d99-4a10-b3d5-60ef7a7b3cfe]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:06 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 Jul 14 21:23:06 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] Acquiring lock "cinder-33a50a58-58ae-4955-aa5b-a3c4b17b7046-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] Lock "cinder-33a50a58-58ae-4955-aa5b-a3c4b17b7046-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] Acquiring lock "cinder-quobyte-33a50a58-58ae-4955-aa5b-a3c4b17b7046" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:06 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7 Jul 14 21:23:06 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] Lock "cinder-quobyte-33a50a58-58ae-4955-aa5b-a3c4b17b7046" acquired by "delete_volume" :: waited 0.070s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:06 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cc9536-f4e6-4c09-af31-eeb4a27539a7]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-33a50a58-58ae-4955-aa5b-a3c4b17b7046 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:07 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851" returned: 0 in 0.779s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:23:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f697d7b9-6840-4df5-bc12-4de5e083d400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e96b347f-94dc-4f63-a82b-4cebf54bd851', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3fc795-c0c3-484e-8f29-9a1e968d71c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:07 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Volume volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 (e96b347f-94dc-4f63-a82b-4cebf54bd851): created successfully Jul 14 21:23:07 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-33a50a58-58ae-4955-aa5b-a3c4b17b7046 Jul 14 21:23:07 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3fc795-c0c3-484e-8f29-9a1e968d71c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Flow 'volume_create_manager' (1bcf3932-14fb-4ee9-af82-6e0c17395ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:07 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-b855b20e-206f-4eec-9870-e1e4ceb47950 tempest-VolumesDeleteCascade-1337992431 None] Created volume successfully. Jul 14 21:23:07 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7" returned: 0 in 0.998s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:07 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7 Jul 14 21:23:07 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:07 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-33a50a58-58ae-4955-aa5b-a3c4b17b7046" returned: 0 in 1.039s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-33a50a58-58ae-4955-aa5b-a3c4b17b7046 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:07 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-33a50a58-58ae-4955-aa5b-a3c4b17b7046 Jul 14 21:23:07 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:07 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7" returned: 0 in 0.585s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] Lock "cinder-quobyte-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7" released by "delete_volume" :: held 1.685s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] Created reservations ['4a49b4fb-9a1f-4ba8-8475-eeec61ab20f4', '39757480-e75e-4ed1-a9c7-adbbdbfafe01', '3cd01377-c383-497b-9d54-35b728d9c60c', 'dea60749-6465-4171-88ea-52507ddc6b61'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:08 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-33a50a58-58ae-4955-aa5b-a3c4b17b7046" returned: 0 in 0.554s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:08 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:23:08 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] Lock "cinder-quobyte-33a50a58-58ae-4955-aa5b-a3c4b17b7046" released by "delete_volume" :: held 1.753s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:08 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.379s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] Creating offline snapshot e8795570-4120-4549-9017-1df41a6e5e5e of volume e96b347f-94dc-4f63-a82b-4cebf54bd851 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:23:08 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] Deleted volume successfully. Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] Created reservations ['858ba674-b61c-461e-95d0-6ce708aa536d', 'a44ef2be-7def-4da6-a460-7d4b2313b109', '58539ba8-a9f7-4240-b52b-58c3d28614a0', 'c7821fff-354f-49ed-830b-cf847cf4ef18'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf9ee83-63c6-4176-bc5a-56dd12c60bbc]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d0537a20-effb-432e-a4d8-490a5850edcf tempest-VolumesListAdminTestJSON-915588992 None] Lock "cinder-ffb0212c-9a80-4a8e-8374-26f4b9d78ba7-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:08 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 Jul 14 21:23:08 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:08 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:23:08 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] Acquiring lock "cinder-feee12fa-7786-47d9-b8ee-27254f91ad94-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] Lock "cinder-feee12fa-7786-47d9-b8ee-27254f91ad94-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] Acquiring lock "cinder-quobyte-feee12fa-7786-47d9-b8ee-27254f91ad94" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] Lock "cinder-quobyte-feee12fa-7786-47d9-b8ee-27254f91ad94" acquired by "delete_volume" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:09 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.528s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:09 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:23:09 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851" returned: 0 in 0.738s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:09 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef332746-3d20-4d06-b878-55a167f645d8]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:09 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] Deleted volume successfully. Jul 14 21:23:09 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e 1G Jul 14 21:23:09 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-feee12fa-7786-47d9-b8ee-27254f91ad94 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a66ba634-1647-483d-8c44-e28fda480f95 tempest-VolumesListAdminTestJSON-1158580553 None] Lock "cinder-33a50a58-58ae-4955-aa5b-a3c4b17b7046-delete_volume" released by "delete_volume" :: held 3.120s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:09 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-feee12fa-7786-47d9-b8ee-27254f91ad94 Jul 14 21:23:09 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:10 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e 1G" returned: 0 in 0.713s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:10 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e Jul 14 21:23:10 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:10 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-feee12fa-7786-47d9-b8ee-27254f91ad94" returned: 0 in 0.729s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-feee12fa-7786-47d9-b8ee-27254f91ad94 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:10 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-feee12fa-7786-47d9-b8ee-27254f91ad94 Jul 14 21:23:10 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:10 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-feee12fa-7786-47d9-b8ee-27254f91ad94" returned: 0 in 0.373s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:10 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] Lock "cinder-quobyte-feee12fa-7786-47d9-b8ee-27254f91ad94" released by "delete_volume" :: held 1.224s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:10 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:UPDATE=150,cinder:DELETE=12,cinder:SELECT=120,cinder:INSERT=36 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:23:10 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=115,cinder:UPDATE=165,cinder:INSERT=38,cinder:DELETE=16 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:23:10 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e" returned: 0 in 0.570s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:10 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e is being set with open permissions: ugo+rw Jul 14 21:23:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:10 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e Jul 14 21:23:10 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:10 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] Created reservations ['c817dace-edc8-4a1a-88b7-34b6c349cda4', '86a65e1e-838c-4741-aa28-8cccec82a09d', '77888435-dd05-45fd-8ccd-f4436e5f0ac7', '985ede83-255d-4558-8bab-0c0e869b96ae'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:11 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:23:11 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:11 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e" returned: 0 in 0.608s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:11 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.info Jul 14 21:23:11 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.687s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:11 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:23:11 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:11 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] Deleted volume successfully. Jul 14 21:23:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2f5da984-0fec-4036-b562-87cb1bd9eafd tempest-VolumesListAdminTestJSON-1158580553 None] Lock "cinder-feee12fa-7786-47d9-b8ee-27254f91ad94-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] Acquiring lock "cinder-fc381acd-bb1b-47ea-b930-e68995bae327-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:12 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.info" returned: 0 in 0.649s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:12 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.info is being set with open permissions: ugo+rw Jul 14 21:23:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] Lock "cinder-fc381acd-bb1b-47ea-b930-e68995bae327-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:12 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.info Jul 14 21:23:12 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] Acquiring lock "cinder-quobyte-fc381acd-bb1b-47ea-b930-e68995bae327" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] Lock "cinder-quobyte-fc381acd-bb1b-47ea-b930-e68995bae327" acquired by "delete_volume" :: waited 0.073s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:12 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9422ce-f75f-4df5-8adf-834274248909]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fc381acd-bb1b-47ea-b930-e68995bae327 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:12 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.info" returned: 0 in 0.420s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.939s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:12 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fc381acd-bb1b-47ea-b930-e68995bae327 Jul 14 21:23:12 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:12 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-89c92429-cafd-4b90-bf71-8ee2808946d7 tempest-VolumesDeleteCascade-1337992431 None] Create snapshot completed successfully Jul 14 21:23:13 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fc381acd-bb1b-47ea-b930-e68995bae327" returned: 0 in 0.782s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fc381acd-bb1b-47ea-b930-e68995bae327 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:13 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fc381acd-bb1b-47ea-b930-e68995bae327 Jul 14 21:23:13 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:13 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fc381acd-bb1b-47ea-b930-e68995bae327" returned: 0 in 0.629s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] Lock "cinder-quobyte-fc381acd-bb1b-47ea-b930-e68995bae327" released by "delete_volume" :: held 1.558s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:13 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] Created reservations ['a4c6d15e-50cc-4c66-9aa4-143f3c426171', '282a146d-611f-44c6-905b-53b6f1ac581c', 'da466ddb-1da6-4c22-b886-90821dbc5d2c', '18c9b4c5-f041-4c81-ad63-c6a72f16aa06'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:23:14 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:23:14 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Flow 'volume_create_manager' (03506dd3-e9ee-4640-b388-08875c3a9854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e32343-2365-4bc9-83b2-bbfc4505f34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e32343-2365-4bc9-83b2-bbfc4505f34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2062692429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d3c111-1311-4104-bf05-ab0b9f03d027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac27738da504480988a205e80130f571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e8795570-4120-4549-9017-1df41a6e5e5e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:14Z,use_quota=True,user_id='553eb6dfe0d9471dac7105b87d786fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0255c97c-102d-4b1d-9eb8-304cc5b489ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0255c97c-102d-4b1d-9eb8-304cc5b489ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87970f3-2c96-403e-aed4-faf98afb2ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87970f3-2c96-403e-aed4-faf98afb2ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b8d3c111-1311-4104-bf05-ab0b9f03d027', 'volume_name': 'volume-b8d3c111-1311-4104-bf05-ab0b9f03d027', 'volume_size': 1, 'snapshot_id': 'e8795570-4120-4549-9017-1df41a6e5e5e'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14d1b5f-b0a7-43b9-a075-b0e221ead15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14d1b5f-b0a7-43b9-a075-b0e221ead15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10f46c8-a1ee-48fe-b0f4-d468c66f5d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:14 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Volume b8d3c111-1311-4104-bf05-ab0b9f03d027: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b8d3c111-1311-4104-bf05-ab0b9f03d027', 'volume_size': 1, 'snapshot_id': 'e8795570-4120-4549-9017-1df41a6e5e5e'} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "cinder-quobyte-e8795570-4120-4549-9017-1df41a6e5e5e-b8d3c111-1311-4104-bf05-ab0b9f03d027" by "_create_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-e8795570-4120-4549-9017-1df41a6e5e5e-b8d3c111-1311-4104-bf05-ab0b9f03d027" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Creating volume b8d3c111-1311-4104-bf05-ab0b9f03d027 from snapshot e8795570-4120-4549-9017-1df41a6e5e5e {{(pid=88300) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "cinder-quobyte-b8d3c111-1311-4104-bf05-ab0b9f03d027" by "_copy_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-b8d3c111-1311-4104-bf05-ab0b9f03d027" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] snapshot: e8795570-4120-4549-9017-1df41a6e5e5e, volume: b8d3c111-1311-4104-bf05-ab0b9f03d027, {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e19c034-e42e-45ec-93d7-a6756e70740c]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:14 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.498s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:23:14 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] Deleted volume successfully. Jul 14 21:23:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-62cf5c9e-58ac-4c9f-bf1f-77a550f6a7ad tempest-VolumesListAdminTestJSON-1158580553 None] Lock "cinder-fc381acd-bb1b-47ea-b930-e68995bae327-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:14 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e Jul 14 21:23:14 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:15 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e" returned: 0 in 0.688s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e96b347f-94dc-4f63-a82b-4cebf54bd851(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:23:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 21:23:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Creating direct copy from snapshot {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 21:23:15 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d10b76-360d-49eb-96ae-5e3dff3eb629]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:15 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 Jul 14 21:23:15 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:15 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851" returned: 0 in 0.517s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:15 devstack cinder-volume[88300]: DEBUG cinder.utils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Path /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8d3c111-1311-4104-bf05-ab0b9f03d027 not found in is_blk_device check {{(pid=88300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 21:23:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8d3c111-1311-4104-bf05-ab0b9f03d027 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:15 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8d3c111-1311-4104-bf05-ab0b9f03d027 Jul 14 21:23:15 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:17 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:23:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Flow 'volume_create_manager' (d0b22264-1e8e-4d6e-8363-eb0214428cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb34641e-c3c6-467e-8191-2214a931b5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb34641e-c3c6-467e-8191-2214a931b5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-713153341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3782f048-b94c-4c91-a617-3eae2356a66c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e8a1a0894845629701dbb6b99cc659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:18Z,use_quota=True,user_id='5f7a1aecd85a4a0fb4ca132ec8e467d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1419765-8155-4fef-a7c4-4064db0615e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1419765-8155-4fef-a7c4-4064db0615e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1e9102-b193-4736-8e24-90170f3b760c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1e9102-b193-4736-8e24-90170f3b760c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3782f048-b94c-4c91-a617-3eae2356a66c', 'volume_name': 'volume-3782f048-b94c-4c91-a617-3eae2356a66c', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ea2ed5-c0ce-40e7-a286-e225762eaf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ea2ed5-c0ce-40e7-a286-e225762eaf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c16008-9467-4532-b401-05169a92ec3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:18 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Volume 3782f048-b94c-4c91-a617-3eae2356a66c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3782f048-b94c-4c91-a617-3eae2356a66c', 'volume_size': 1} Jul 14 21:23:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:21 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8d3c111-1311-4104-bf05-ab0b9f03d027" returned: 0 in 6.149s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:21 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6278c410-a83b-48b7-9503-658a88b91177]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:22 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 Jul 14 21:23:22 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:22 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851" returned: 0 in 0.684s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:22 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Image conversion details: src /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8d3c111-1311-4104-bf05-ab0b9f03d027 {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:23:22 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Converted 1024.00 MB image at 166.50 MB/s Jul 14 21:23:22 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8d3c111-1311-4104-bf05-ab0b9f03d027 is being set with open permissions: ugo+rw Jul 14 21:23:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8d3c111-1311-4104-bf05-ab0b9f03d027 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:22 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8d3c111-1311-4104-bf05-ab0b9f03d027 Jul 14 21:23:22 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:23 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8d3c111-1311-4104-bf05-ab0b9f03d027" returned: 0 in 0.452s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-b8d3c111-1311-4104-bf05-ab0b9f03d027" released by "_copy_volume_from_snapshot" :: held 8.635s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-e8795570-4120-4549-9017-1df41a6e5e5e-b8d3c111-1311-4104-bf05-ab0b9f03d027" released by "_create_volume_from_snapshot" :: held 8.682s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.713s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.994s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-713153341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3782f048-b94c-4c91-a617-3eae2356a66c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e8a1a0894845629701dbb6b99cc659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:18Z,use_quota=True,user_id='5f7a1aecd85a4a0fb4ca132ec8e467d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Creating volume 3782f048-b94c-4c91-a617-3eae2356a66c {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:23:23 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3782f048-b94c-4c91-a617-3eae2356a66c 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:23 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3782f048-b94c-4c91-a617-3eae2356a66c 1073741824 Jul 14 21:23:23 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10f46c8-a1ee-48fe-b0f4-d468c66f5d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8d3c111-1311-4104-bf05-ab0b9f03d027', 'volume_size': 1, 'snapshot_id': 'e8795570-4120-4549-9017-1df41a6e5e5e'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae9dd4a-cbd8-4a46-96de-561e53147024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:23 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Volume volume-b8d3c111-1311-4104-bf05-ab0b9f03d027 (b8d3c111-1311-4104-bf05-ab0b9f03d027): created successfully Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae9dd4a-cbd8-4a46-96de-561e53147024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Flow 'volume_create_manager' (03506dd3-e9ee-4640-b388-08875c3a9854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:23 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-55954afa-e23a-4978-81fd-f1e584c5ec79 tempest-VolumesDeleteCascade-1337992431 None] Created volume successfully. Jul 14 21:23:23 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3782f048-b94c-4c91-a617-3eae2356a66c 1073741824" returned: 0 in 0.698s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3782f048-b94c-4c91-a617-3eae2356a66c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:23 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3782f048-b94c-4c91-a617-3eae2356a66c Jul 14 21:23:23 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:24 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3782f048-b94c-4c91-a617-3eae2356a66c" returned: 0 in 0.376s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c16008-9467-4532-b401-05169a92ec3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3782f048-b94c-4c91-a617-3eae2356a66c', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e75174c-76dc-416c-b418-8c04448e1404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:24 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Volume volume-3782f048-b94c-4c91-a617-3eae2356a66c (3782f048-b94c-4c91-a617-3eae2356a66c): created successfully Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e75174c-76dc-416c-b418-8c04448e1404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Flow 'volume_create_manager' (d0b22264-1e8e-4d6e-8363-eb0214428cf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:24 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-1a3ff314-c0dc-415d-9565-5c6efe3e6678 tempest-TestMinimumBasicScenario-1290309383 None] Created volume successfully. Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "cinder-e96b347f-94dc-4f63-a82b-4cebf54bd851-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-e96b347f-94dc-4f63-a82b-4cebf54bd851-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Performing cascade delete. {{(pid=88300) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "cinder-e8795570-4120-4549-9017-1df41a6e5e5e-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-e8795570-4120-4549-9017-1df41a6e5e5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "cinder-quobyte-e96b347f-94dc-4f63-a82b-4cebf54bd851" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-e96b347f-94dc-4f63-a82b-4cebf54bd851" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "cinder-quobyte-e8795570-4120-4549-9017-1df41a6e5e5e" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-e8795570-4120-4549-9017-1df41a6e5e5e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Deleting offline snapshot e8795570-4120-4549-9017-1df41a6e5e5e of volume e96b347f-94dc-4f63-a82b-4cebf54bd851 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] snapshot_file for this snap is: volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd2fb31-04ec-4e0b-a672-52fe1f879cb9]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:24 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e Jul 14 21:23:24 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:25 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e" returned: 0 in 0.453s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e96b347f-94dc-4f63-a82b-4cebf54bd851(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:23:25 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0eb0f89-68a5-4355-a7c1-3061bfd3b37b]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:25 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 Jul 14 21:23:25 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:26 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851" returned: 0 in 0.731s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:26 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e Jul 14 21:23:26 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Flow 'volume_create_manager' (6c0fa002-0d0c-4591-a005-4bdf3dfdd395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110beb82-f844-49cd-985a-add00387309f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110beb82-f844-49cd-985a-add00387309f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-554243002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8749c1bc-303b-4079-a20d-c7987f032e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e3ec1e91424dd694bf6009f3672b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:26Z,use_quota=True,user_id='34f199c456d64f4cb2d1deb4011e6abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d55cc2-2df1-44ff-8eb3-e17968862951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d55cc2-2df1-44ff-8eb3-e17968862951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0de906-ffd6-4d39-be8d-17af1f9dba5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0de906-ffd6-4d39-be8d-17af1f9dba5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8749c1bc-303b-4079-a20d-c7987f032e5d', 'volume_name': 'volume-8749c1bc-303b-4079-a20d-c7987f032e5d', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f54bb14-cc40-4c2c-ab0b-3eb1be82c983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f54bb14-cc40-4c2c-ab0b-3eb1be82c983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56add7c7-69dd-46cf-aa4e-70b1359cb1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:26 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Volume 8749c1bc-303b-4079-a20d-c7987f032e5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8749c1bc-303b-4079-a20d-c7987f032e5d', 'volume_size': 1} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-554243002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8749c1bc-303b-4079-a20d-c7987f032e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e3ec1e91424dd694bf6009f3672b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:26Z,use_quota=True,user_id='34f199c456d64f4cb2d1deb4011e6abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Creating volume 8749c1bc-303b-4079-a20d-c7987f032e5d {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:23:26 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8749c1bc-303b-4079-a20d-c7987f032e5d 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:26 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8749c1bc-303b-4079-a20d-c7987f032e5d 1073741824 Jul 14 21:23:26 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:26 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e" returned: 0 in 0.779s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:26 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e Jul 14 21:23:26 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:27 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8749c1bc-303b-4079-a20d-c7987f032e5d 1073741824" returned: 0 in 0.952s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8749c1bc-303b-4079-a20d-c7987f032e5d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:27 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8749c1bc-303b-4079-a20d-c7987f032e5d Jul 14 21:23:27 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-653dc89d-9805-4873-bd5e-2026a32212f6 req-55649be5-846f-441c-985c-f7781c3fd2a8 tempest-TestMinimumBasicScenario-1290309383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:27 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851.e8795570-4120-4549-9017-1df41a6e5e5e" returned: 0 in 0.571s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-e8795570-4120-4549-9017-1df41a6e5e5e" released by "_delete_snapshot" :: held 2.675s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-e96b347f-94dc-4f63-a82b-4cebf54bd851" released by "delete_snapshot" :: held 2.707s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Created reservations ['654ad826-4d3a-4d5e-8481-7b3cbdd876b1', '1e55ae7f-1fa2-4c0d-8a27-0768ce3eda20', '9e4b0139-b06d-4805-ad75-c5899762a1a6', '2b917d74-eda8-4e28-b4cc-1ded63b8aaa1'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:27 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Delete snapshot completed successfully. Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-e8795570-4120-4549-9017-1df41a6e5e5e-delete_snapshot" released by "delete_snapshot" :: held 2.974s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Snapshots deleted, issuing volume delete {{(pid=88300) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "cinder-quobyte-e96b347f-94dc-4f63-a82b-4cebf54bd851" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-e96b347f-94dc-4f63-a82b-4cebf54bd851" acquired by "delete_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b9e6c0-c092-4d80-adba-668ea071b7cf]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:27 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8749c1bc-303b-4079-a20d-c7987f032e5d" returned: 0 in 0.568s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-653dc89d-9805-4873-bd5e-2026a32212f6 req-55649be5-846f-441c-985c-f7781c3fd2a8 tempest-TestMinimumBasicScenario-1290309383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.508s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56add7c7-69dd-46cf-aa4e-70b1359cb1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8749c1bc-303b-4079-a20d-c7987f032e5d', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99cc5c9b-a938-47be-8f86-ca593bc63774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c20d78-bab6-4891-9ba3-2ee98afd219d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-653dc89d-9805-4873-bd5e-2026a32212f6 req-55649be5-846f-441c-985c-f7781c3fd2a8 tempest-TestMinimumBasicScenario-1290309383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3782f048-b94c-4c91-a617-3eae2356a66c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:28 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 Jul 14 21:23:28 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:28 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Volume volume-8749c1bc-303b-4079-a20d-c7987f032e5d (8749c1bc-303b-4079-a20d-c7987f032e5d): created successfully Jul 14 21:23:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99cc5c9b-a938-47be-8f86-ca593bc63774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Flow 'volume_create_manager' (6c0fa002-0d0c-4591-a005-4bdf3dfdd395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:28 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e9314966-22cf-4e06-890e-8ad87accd425 tempest-AttachVolumeNegativeTest-850271826 None] Created volume successfully. Jul 14 21:23:28 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3782f048-b94c-4c91-a617-3eae2356a66c Jul 14 21:23:28 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:28 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851" returned: 0 in 0.666s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:28 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851 Jul 14 21:23:28 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:28 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-653dc89d-9805-4873-bd5e-2026a32212f6 req-55649be5-846f-441c-985c-f7781c3fd2a8 tempest-TestMinimumBasicScenario-1290309383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3782f048-b94c-4c91-a617-3eae2356a66c" returned: 0 in 0.624s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-653dc89d-9805-4873-bd5e-2026a32212f6 req-55649be5-846f-441c-985c-f7781c3fd2a8 tempest-TestMinimumBasicScenario-1290309383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.697s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-653dc89d-9805-4873-bd5e-2026a32212f6 req-55649be5-846f-441c-985c-f7781c3fd2a8 tempest-TestMinimumBasicScenario-1290309383 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-3782f048-b94c-4c91-a617-3eae2356a66c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71ab1995-7e81-4321-af43-60543547ebc6', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:23:28 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-653dc89d-9805-4873-bd5e-2026a32212f6 req-55649be5-846f-441c-985c-f7781c3fd2a8 tempest-TestMinimumBasicScenario-1290309383 None] attachment_update completed successfully. Jul 14 21:23:28 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e96b347f-94dc-4f63-a82b-4cebf54bd851" returned: 0 in 0.548s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-e96b347f-94dc-4f63-a82b-4cebf54bd851" released by "delete_volume" :: held 1.303s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Created reservations ['d87c9ce2-457d-4422-afdc-72ef355b4b6e', 'b3f1ab3a-a0a0-41cc-9db2-1ca20a37742a', '39b085c0-4d88-4ab5-8648-501ef165a34e', '88485a47-1a03-494a-91f0-2b1e6af16d5d'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:29 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:23:29 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "cinder-b8d3c111-1311-4104-bf05-ab0b9f03d027-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-b8d3c111-1311-4104-bf05-ab0b9f03d027-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-f1de9a54-c930-42c4-984a-13b8d241e376 req-98483991-d85e-4e8c-9369-a39d69bc7df3 tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-f1de9a54-c930-42c4-984a-13b8d241e376 req-98483991-d85e-4e8c-9369-a39d69bc7df3 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4852184-570f-4ea9-b9b3-4f9d2895720e]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-f1de9a54-c930-42c4-984a-13b8d241e376 req-98483991-d85e-4e8c-9369-a39d69bc7df3 tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8749c1bc-303b-4079-a20d-c7987f032e5d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "cinder-quobyte-b8d3c111-1311-4104-bf05-ab0b9f03d027" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-b8d3c111-1311-4104-bf05-ab0b9f03d027" acquired by "delete_volume" :: waited 0.031s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cbc25b-6686-4782-85ad-5df11727998e]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8d3c111-1311-4104-bf05-ab0b9f03d027 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:29 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.535s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:23:29 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Deleted volume successfully. Jul 14 21:23:29 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8749c1bc-303b-4079-a20d-c7987f032e5d Jul 14 21:23:29 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2430d3a1-eb89-435b-826e-56f45a66c098 tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-e96b347f-94dc-4f63-a82b-4cebf54bd851-delete_volume" released by "delete_volume" :: held 5.192s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:29 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8d3c111-1311-4104-bf05-ab0b9f03d027 Jul 14 21:23:29 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:30 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-f1de9a54-c930-42c4-984a-13b8d241e376 req-98483991-d85e-4e8c-9369-a39d69bc7df3 tempest-AttachVolumeNegativeTest-850271826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8749c1bc-303b-4079-a20d-c7987f032e5d" returned: 0 in 0.489s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-f1de9a54-c930-42c4-984a-13b8d241e376 req-98483991-d85e-4e8c-9369-a39d69bc7df3 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.533s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-f1de9a54-c930-42c4-984a-13b8d241e376 req-98483991-d85e-4e8c-9369-a39d69bc7df3 tempest-AttachVolumeNegativeTest-850271826 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-8749c1bc-303b-4079-a20d-c7987f032e5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5807e29-e485-44c1-a9b0-a58aac49612d', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:23:30 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-f1de9a54-c930-42c4-984a-13b8d241e376 req-98483991-d85e-4e8c-9369-a39d69bc7df3 tempest-AttachVolumeNegativeTest-850271826 None] attachment_update completed successfully. Jul 14 21:23:30 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8d3c111-1311-4104-bf05-ab0b9f03d027" returned: 0 in 0.506s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8d3c111-1311-4104-bf05-ab0b9f03d027 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:30 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8d3c111-1311-4104-bf05-ab0b9f03d027 Jul 14 21:23:30 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:30 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b8d3c111-1311-4104-bf05-ab0b9f03d027" returned: 0 in 0.388s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:30 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-quobyte-b8d3c111-1311-4104-bf05-ab0b9f03d027" released by "delete_volume" :: held 0.958s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:30 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] Created reservations ['090d7689-e383-4c55-83dd-ca265e1ef54a', '671de163-88a0-41c4-b74d-251433a36f99', '42c6887c-2638-4398-8902-35ed604b212c', '1422b937-f7be-460b-90e3-cd21dec0229e'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:30 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:23:30 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Flow 'volume_create_manager' (4ea8c590-833b-45f3-9333-a47d27e781ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91de75b8-5389-4315-82a3-e3280f453f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91de75b8-5389-4315-82a3-e3280f453f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-821822822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68044027-a6f1-40a0-85e9-a54e6ab06896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72c00efe3534abd8f2c4ed91b68b426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:31Z,use_quota=True,user_id='2ee8eb46ce20449ba0ad072042fd6755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e763ca-b5a2-47c8-99b3-a1ccbb5e87bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:31 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e763ca-b5a2-47c8-99b3-a1ccbb5e87bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e00f17c-0cb0-418f-b771-494198f81cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e00f17c-0cb0-418f-b771-494198f81cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68044027-a6f1-40a0-85e9-a54e6ab06896', 'volume_name': 'volume-68044027-a6f1-40a0-85e9-a54e6ab06896', 'volume_size': 2}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b2c699-7736-4250-97e5-7aa0da8ee807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b2c699-7736-4250-97e5-7aa0da8ee807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53d87e5-72c5-4d14-adc0-8f1d09b38156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:31 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Volume 68044027-a6f1-40a0-85e9-a54e6ab06896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68044027-a6f1-40a0-85e9-a54e6ab06896', 'volume_size': 2} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-821822822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68044027-a6f1-40a0-85e9-a54e6ab06896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72c00efe3534abd8f2c4ed91b68b426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:31Z,use_quota=True,user_id='2ee8eb46ce20449ba0ad072042fd6755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Creating volume 68044027-a6f1-40a0-85e9-a54e6ab06896 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:23:31 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-68044027-a6f1-40a0-85e9-a54e6ab06896 2147483648 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.457s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:23:31 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] Deleted volume successfully. Jul 14 21:23:31 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-68044027-a6f1-40a0-85e9-a54e6ab06896 2147483648 Jul 14 21:23:31 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c7aeb922-72aa-4a32-aa6f-bbb146a4640c tempest-VolumesDeleteCascade-1337992431 None] Lock "cinder-b8d3c111-1311-4104-bf05-ab0b9f03d027-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:32 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-68044027-a6f1-40a0-85e9-a54e6ab06896 2147483648" returned: 0 in 0.809s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-68044027-a6f1-40a0-85e9-a54e6ab06896 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:32 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-68044027-a6f1-40a0-85e9-a54e6ab06896 Jul 14 21:23:32 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:32 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-c923da40-843a-4a72-9e7a-04575071263b req-8e1f8a1c-6991-4620-b0c6-0c859d702bab tempest-AttachVolumeNegativeTest-850271826 None] Terminate volume connection completed successfully. Jul 14 21:23:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-c923da40-843a-4a72-9e7a-04575071263b req-8e1f8a1c-6991-4620-b0c6-0c859d702bab tempest-AttachVolumeNegativeTest-850271826 None] Deleting attachment b5807e29-e485-44c1-a9b0-a58aac49612d. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:23:32 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-68044027-a6f1-40a0-85e9-a54e6ab06896" returned: 0 in 0.479s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:23:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53d87e5-72c5-4d14-adc0-8f1d09b38156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68044027-a6f1-40a0-85e9-a54e6ab06896', 'volume_size': 2}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568b8a96-6a7e-4d64-a663-8c79c9256f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:32 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Volume volume-68044027-a6f1-40a0-85e9-a54e6ab06896 (68044027-a6f1-40a0-85e9-a54e6ab06896): created successfully Jul 14 21:23:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568b8a96-6a7e-4d64-a663-8c79c9256f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Flow 'volume_create_manager' (4ea8c590-833b-45f3-9333-a47d27e781ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:32 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a141f3c9-70d7-4280-b4d9-5272de2fe850 tempest-VolumesCloneNegativeTest-1001953967 None] Created volume successfully. Jul 14 21:23:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] Acquiring lock "cinder-68044027-a6f1-40a0-85e9-a54e6ab06896-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] Lock "cinder-68044027-a6f1-40a0-85e9-a54e6ab06896-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] Acquiring lock "cinder-quobyte-68044027-a6f1-40a0-85e9-a54e6ab06896" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] Lock "cinder-quobyte-68044027-a6f1-40a0-85e9-a54e6ab06896" acquired by "delete_volume" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:33 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64ba6c2-52a0-4c87-a406-d250f10edc3d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-68044027-a6f1-40a0-85e9-a54e6ab06896 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:34 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-68044027-a6f1-40a0-85e9-a54e6ab06896 Jul 14 21:23:34 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:34 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-68044027-a6f1-40a0-85e9-a54e6ab06896" returned: 0 in 0.704s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-68044027-a6f1-40a0-85e9-a54e6ab06896 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:34 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-68044027-a6f1-40a0-85e9-a54e6ab06896 Jul 14 21:23:34 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:34 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-68044027-a6f1-40a0-85e9-a54e6ab06896" returned: 0 in 0.451s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] Lock "cinder-quobyte-68044027-a6f1-40a0-85e9-a54e6ab06896" released by "delete_volume" :: held 1.247s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:35 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] Created reservations ['762aeabe-1842-4136-8211-68cf634a60a9', '91c7053c-56fc-4e28-a9de-e572ed3627d4', '784047d4-5f8f-4f3d-838b-c116cf392143', 'eee9dd35-d436-4102-9ed9-0a5e74cce3c4'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:35 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:23:35 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:35 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.563s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:35 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:23:35 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] Deleted volume successfully. Jul 14 21:23:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-25b6e5d1-e058-4f1b-b6af-6a0cd6813756 tempest-VolumesCloneNegativeTest-1001953967 None] Lock "cinder-68044027-a6f1-40a0-85e9-a54e6ab06896-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:23:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:36 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:23:36 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:36 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:23:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Flow 'volume_create_manager' (b7c2be21-36ac-4cd7-831e-c88b64967c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8ded2a-b6bb-4c15-8a85-4a7df7e22b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8ded2a-b6bb-4c15-8a85-4a7df7e22b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1603592248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6226d9693f0544629a131adc787f0d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:37Z,use_quota=True,user_id='a08face598e1445f9629fb316290738c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8a7d9d-b764-4a73-b6e9-7f5863877b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8a7d9d-b764-4a73-b6e9-7f5863877b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8eb4ab5-e043-4950-adce-c1e7af6491d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8eb4ab5-e043-4950-adce-c1e7af6491d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2', 'volume_name': 'volume-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b539be-8947-436a-9a19-4e6f6f810184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b539be-8947-436a-9a19-4e6f6f810184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22bc2ab0-c823-46a2-97ff-1513e8fc0d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:37 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Volume 9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2', 'volume_size': 1} Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1603592248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6226d9693f0544629a131adc787f0d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:37Z,use_quota=True,user_id='a08face598e1445f9629fb316290738c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Creating volume 9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:23:37 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:37 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2 1073741824 Jul 14 21:23:37 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:37 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.566s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 28 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:23:37 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2 1073741824" returned: 0 in 0.733s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:37 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2 Jul 14 21:23:37 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:38 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2" returned: 0 in 0.370s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:23:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22bc2ab0-c823-46a2-97ff-1513e8fc0d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4aa617-bf58-4425-b715-62b167d76b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:38 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Volume volume-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2 (9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2): created successfully Jul 14 21:23:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4aa617-bf58-4425-b715-62b167d76b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Flow 'volume_create_manager' (b7c2be21-36ac-4cd7-831e-c88b64967c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:38 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0ea6c164-8b45-429c-9220-6e5098339f2e tempest-VolumesMetadataTest-1167462835 None] Created volume successfully. Jul 14 21:23:38 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "cinder-8749c1bc-303b-4079-a20d-c7987f032e5d-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] Lock "cinder-8749c1bc-303b-4079-a20d-c7987f032e5d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "cinder-quobyte-8749c1bc-303b-4079-a20d-c7987f032e5d" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] Lock "cinder-quobyte-8749c1bc-303b-4079-a20d-c7987f032e5d" acquired by "delete_volume" :: waited 0.028s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:39 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5863c6b-9f8c-4416-90c1-1e1bc40ada76]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8749c1bc-303b-4079-a20d-c7987f032e5d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:39 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8749c1bc-303b-4079-a20d-c7987f032e5d Jul 14 21:23:39 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:39 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8749c1bc-303b-4079-a20d-c7987f032e5d" returned: 0 in 0.485s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8749c1bc-303b-4079-a20d-c7987f032e5d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:39 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8749c1bc-303b-4079-a20d-c7987f032e5d Jul 14 21:23:39 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] Acquiring lock "cinder-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] Lock "cinder-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] Acquiring lock "cinder-quobyte-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:40 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8749c1bc-303b-4079-a20d-c7987f032e5d" returned: 0 in 0.333s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] Lock "cinder-quobyte-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2" acquired by "delete_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] Lock "cinder-quobyte-8749c1bc-303b-4079-a20d-c7987f032e5d" released by "delete_volume" :: held 0.913s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bf2618-b22a-4d0f-8ef3-7260763108a6]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] Created reservations ['a75182fe-64af-4175-a992-3b63545519a7', 'e5c2b34f-79c5-48a8-a94a-b9c3a702760d', '82314cbb-4265-42d3-b30b-999913403480', '080b05ad-8440-491c-9aaa-02aa7add4096'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:40 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2 Jul 14 21:23:40 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:40 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:23:40 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "cinder-1c964b86-26b9-4421-a07e-4b1318a01712-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] Lock "cinder-1c964b86-26b9-4421-a07e-4b1318a01712-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:40 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "cinder-quobyte-1c964b86-26b9-4421-a07e-4b1318a01712" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.475s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:23:40 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] Lock "cinder-quobyte-1c964b86-26b9-4421-a07e-4b1318a01712" acquired by "delete_volume" :: waited 0.048s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:40 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] Deleted volume successfully. Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2" returned: 0 in 0.702s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f15cb2-5c13-41e7-801c-c3a2e0bbb747]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1c964b86-26b9-4421-a07e-4b1318a01712 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:40 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2 Jul 14 21:23:40 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1d4b759c-c25a-4e92-8c6c-4cda861932a5 tempest-AttachVolumeNegativeTest-850271826 None] Lock "cinder-8749c1bc-303b-4079-a20d-c7987f032e5d-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:40 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:23:40 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1c964b86-26b9-4421-a07e-4b1318a01712 Jul 14 21:23:40 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Flow 'volume_create_manager' (66a67a15-c89e-4a82-88df-07df14ec9cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6d3f8d-cd4c-4380-9a41-f9615498e146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6d3f8d-cd4c-4380-9a41-f9615498e146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-622048275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4ca224-3e00-4138-9e41-dced6c9be978,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e93c3c83ddf547268ef4de084c3ee49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:41Z,use_quota=True,user_id='a8ace832a1974bb69a080d723d3131ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9413b7d2-b0bb-4ad5-9f14-1c70c20734b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9413b7d2-b0bb-4ad5-9f14-1c70c20734b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e80ef35-b45d-418b-aa7c-f64bafe0a229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e80ef35-b45d-418b-aa7c-f64bafe0a229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa4ca224-3e00-4138-9e41-dced6c9be978', 'volume_name': 'volume-fa4ca224-3e00-4138-9e41-dced6c9be978', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdf35ee-2fb4-4d6b-8c84-25c3c6c9a4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdf35ee-2fb4-4d6b-8c84-25c3c6c9a4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83765e3-ba13-4be5-969e-67b57711e860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:41 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Volume fa4ca224-3e00-4138-9e41-dced6c9be978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa4ca224-3e00-4138-9e41-dced6c9be978', 'volume_size': 1} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-622048275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4ca224-3e00-4138-9e41-dced6c9be978,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e93c3c83ddf547268ef4de084c3ee49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:41Z,use_quota=True,user_id='a8ace832a1974bb69a080d723d3131ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Creating volume fa4ca224-3e00-4138-9e41-dced6c9be978 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:23:41 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fa4ca224-3e00-4138-9e41-dced6c9be978 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:41 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2" returned: 0 in 0.398s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:41 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fa4ca224-3e00-4138-9e41-dced6c9be978 1073741824 Jul 14 21:23:41 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] Lock "cinder-quobyte-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2" released by "delete_volume" :: held 1.171s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] Created reservations ['d8c030dc-f8d6-4e8f-9c12-39b319919c53', 'f88ccbb4-e049-4e5d-b491-270fd2224f17', '2c2ea034-d225-4685-88a9-3a0fdf592a4a', 'ef354304-51a5-4923-970a-e489a36ab89f'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:41 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1c964b86-26b9-4421-a07e-4b1318a01712" returned: 0 in 0.655s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1c964b86-26b9-4421-a07e-4b1318a01712 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:41 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:23:41 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:41 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1c964b86-26b9-4421-a07e-4b1318a01712 Jul 14 21:23:41 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:41 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1c964b86-26b9-4421-a07e-4b1318a01712" returned: 0 in 0.348s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] Lock "cinder-quobyte-1c964b86-26b9-4421-a07e-4b1318a01712" released by "delete_volume" :: held 1.073s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:41 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.417s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:23:41 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] Deleted volume successfully. Jul 14 21:23:41 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fa4ca224-3e00-4138-9e41-dced6c9be978 1073741824" returned: 0 in 0.716s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea9c10a6-2ddb-42e6-907f-7336e3cf6e37 tempest-VolumesMetadataTest-1167462835 None] Lock "cinder-9f6f5f1b-e9bd-494f-8b23-e78e7f7613e2-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] Created reservations ['863e5d1c-3cc9-40f7-bd7e-42d263db9143', '751be8d4-19eb-4ccc-9931-bdd95257e694', 'a72d0cb5-ac97-4337-bd39-ff8e770d7c73', '424e27b2-c38d-42e2-a402-fd8cfc515ee5'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fa4ca224-3e00-4138-9e41-dced6c9be978 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:41 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fa4ca224-3e00-4138-9e41-dced6c9be978 Jul 14 21:23:41 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:42 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:42 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:42 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:23:42 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:42 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fa4ca224-3e00-4138-9e41-dced6c9be978" returned: 0 in 0.314s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:42 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:23:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:42 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83765e3-ba13-4be5-969e-67b57711e860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa4ca224-3e00-4138-9e41-dced6c9be978', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:42 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39c0c1d-b92a-4e7a-8739-6cb8f289a56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:42 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Volume volume-fa4ca224-3e00-4138-9e41-dced6c9be978 (fa4ca224-3e00-4138-9e41-dced6c9be978): created successfully Jul 14 21:23:42 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39c0c1d-b92a-4e7a-8739-6cb8f289a56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:42 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Flow 'volume_create_manager' (66a67a15-c89e-4a82-88df-07df14ec9cbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:42 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e7394601-9fb5-46eb-93a1-d6565ed01889 tempest-VolumesGetTest-1200256954 None] Created volume successfully. Jul 14 21:23:42 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.339s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:42 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:23:42 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] Deleted volume successfully. Jul 14 21:23:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1620b1ff-3651-41ad-96f3-bcc482620dca tempest-AttachVolumeNegativeTest-850271826 None] Lock "cinder-1c964b86-26b9-4421-a07e-4b1318a01712-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "cinder-b6eeae0d-d0e1-4d36-abbe-54d778445177-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] Lock "cinder-b6eeae0d-d0e1-4d36-abbe-54d778445177-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "cinder-quobyte-b6eeae0d-d0e1-4d36-abbe-54d778445177" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] Lock "cinder-quobyte-b6eeae0d-d0e1-4d36-abbe-54d778445177" acquired by "delete_volume" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b4813e-ed97-472f-921d-01286e922ad8]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b6eeae0d-d0e1-4d36-abbe-54d778445177 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:43 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b6eeae0d-d0e1-4d36-abbe-54d778445177 Jul 14 21:23:43 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:43 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b6eeae0d-d0e1-4d36-abbe-54d778445177" returned: 0 in 0.423s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b6eeae0d-d0e1-4d36-abbe-54d778445177 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:43 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b6eeae0d-d0e1-4d36-abbe-54d778445177 Jul 14 21:23:43 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:23:43 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Flow 'volume_create_manager' (68271917-a828-49b1-b356-cad1d3a9a703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8be533-0d85-4dfb-bebe-33695792a25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b6eeae0d-d0e1-4d36-abbe-54d778445177" returned: 0 in 0.298s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8be533-0d85-4dfb-bebe-33695792a25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1673627434',display_name='tempest-VolumesGetTest-Volume-1309537433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060e25be-eb3c-4963-a427-2e04ae0573d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93c3c83ddf547268ef4de084c3ee49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:44Z,use_quota=True,user_id='a8ace832a1974bb69a080d723d3131ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41e920a-999c-43e9-a14e-88775da99547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d41e920a-999c-43e9-a14e-88775da99547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0019c14-1e3a-4587-9ac6-78bf42649125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0019c14-1e3a-4587-9ac6-78bf42649125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '060e25be-eb3c-4963-a427-2e04ae0573d4', 'volume_name': 'volume-060e25be-eb3c-4963-a427-2e04ae0573d4', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37edb9f4-7195-4783-82dd-faf05a02080c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37edb9f4-7195-4783-82dd-faf05a02080c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fcd2f9-485c-4fe8-a188-e9814d72e9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:43 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Volume 060e25be-eb3c-4963-a427-2e04ae0573d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-060e25be-eb3c-4963-a427-2e04ae0573d4', 'volume_size': 1} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1673627434',display_name='tempest-VolumesGetTest-Volume-1309537433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060e25be-eb3c-4963-a427-2e04ae0573d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93c3c83ddf547268ef4de084c3ee49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:44Z,use_quota=True,user_id='a8ace832a1974bb69a080d723d3131ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Creating volume 060e25be-eb3c-4963-a427-2e04ae0573d4 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:23:43 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-060e25be-eb3c-4963-a427-2e04ae0573d4 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:43 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] Lock "cinder-quobyte-b6eeae0d-d0e1-4d36-abbe-54d778445177" released by "delete_volume" :: held 0.836s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:43 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-060e25be-eb3c-4963-a427-2e04ae0573d4 1073741824 Jul 14 21:23:43 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] Created reservations ['53a790e5-6976-4893-a8ed-e078fb6b3279', '4524f918-ce22-4200-8678-d7ac3132ab78', '3ddb8b6d-5691-44df-bf31-111e84ed1b29', 'e66916a5-dd4b-4960-bbdd-9c4b93bf5ddc'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:44 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:23:44 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:44 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.322s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:23:44 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] Deleted volume successfully. Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-65d68bd6-9ad7-4459-a779-8dcd69f1703d tempest-AttachVolumeNegativeTest-850271826 None] Lock "cinder-b6eeae0d-d0e1-4d36-abbe-54d778445177-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:44 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-060e25be-eb3c-4963-a427-2e04ae0573d4 1073741824" returned: 0 in 0.582s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-060e25be-eb3c-4963-a427-2e04ae0573d4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:44 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-060e25be-eb3c-4963-a427-2e04ae0573d4 Jul 14 21:23:44 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:44 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-060e25be-eb3c-4963-a427-2e04ae0573d4" returned: 0 in 0.262s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fcd2f9-485c-4fe8-a188-e9814d72e9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-060e25be-eb3c-4963-a427-2e04ae0573d4', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85f9963-4de0-4d52-a8b1-647b561326e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:44 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Volume volume-060e25be-eb3c-4963-a427-2e04ae0573d4 (060e25be-eb3c-4963-a427-2e04ae0573d4): created successfully Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85f9963-4de0-4d52-a8b1-647b561326e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Flow 'volume_create_manager' (68271917-a828-49b1-b356-cad1d3a9a703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:44 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-04af73ec-8306-4e77-be20-3f9f29fb3831 tempest-VolumesGetTest-1200256954 None] Created volume successfully. Jul 14 21:23:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] Acquiring lock "cinder-060e25be-eb3c-4963-a427-2e04ae0573d4-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] Lock "cinder-060e25be-eb3c-4963-a427-2e04ae0573d4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] Acquiring lock "cinder-quobyte-060e25be-eb3c-4963-a427-2e04ae0573d4" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-060e25be-eb3c-4963-a427-2e04ae0573d4" acquired by "delete_volume" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:46 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbcc2d9-ea83-4ef6-9c94-d88a23b2eca2]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-060e25be-eb3c-4963-a427-2e04ae0573d4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:46 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-060e25be-eb3c-4963-a427-2e04ae0573d4 Jul 14 21:23:46 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:46 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-060e25be-eb3c-4963-a427-2e04ae0573d4" returned: 0 in 0.408s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-060e25be-eb3c-4963-a427-2e04ae0573d4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:46 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-060e25be-eb3c-4963-a427-2e04ae0573d4 Jul 14 21:23:46 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:46 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-060e25be-eb3c-4963-a427-2e04ae0573d4" returned: 0 in 0.328s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-060e25be-eb3c-4963-a427-2e04ae0573d4" released by "delete_volume" :: held 0.787s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] Created reservations ['74df78a1-ca94-4fb7-9a79-84995ce1c845', 'c61c42c8-f064-413a-a497-882246b089ec', '2179c5e6-6012-4109-a050-aabd29fffcf7', 'ed79c154-bbc2-4e20-86f7-adb70429111c'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:47 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:23:47 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Flow 'volume_create_manager' (16147e81-7a5c-4269-ba00-941c1eff00c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf864981-1e41-4a6c-b09a-e7fa4ed07f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] Acquiring lock "cinder-fa4ca224-3e00-4138-9e41-dced6c9be978-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf864981-1e41-4a6c-b09a-e7fa4ed07f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-560883938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9776aeb6-32df-49d3-956c-a17e2167916a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0298b70fa81246cab3f83645a1c75368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:47Z,use_quota=True,user_id='20aa0e3c8dde41b6b7ac8a086846daa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc088592-1dcb-4c00-aef5-8ce0a6686219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc088592-1dcb-4c00-aef5-8ce0a6686219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a0d23c-70a9-4072-915d-9c28380e85f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a0d23c-70a9-4072-915d-9c28380e85f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9776aeb6-32df-49d3-956c-a17e2167916a', 'volume_name': 'volume-9776aeb6-32df-49d3-956c-a17e2167916a', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4966629-9f6e-4836-b004-1ae88a16c236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4966629-9f6e-4836-b004-1ae88a16c236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006b574c-5cc5-4c8a-a4fe-93a3b0262131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:47 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Volume 9776aeb6-32df-49d3-956c-a17e2167916a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9776aeb6-32df-49d3-956c-a17e2167916a', 'volume_size': 1} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-560883938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9776aeb6-32df-49d3-956c-a17e2167916a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0298b70fa81246cab3f83645a1c75368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:47Z,use_quota=True,user_id='20aa0e3c8dde41b6b7ac8a086846daa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Creating volume 9776aeb6-32df-49d3-956c-a17e2167916a {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:23:47 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9776aeb6-32df-49d3-956c-a17e2167916a 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] Lock "cinder-fa4ca224-3e00-4138-9e41-dced6c9be978-delete_volume" acquired by "delete_volume" :: waited 0.188s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:47 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9776aeb6-32df-49d3-956c-a17e2167916a 1073741824 Jul 14 21:23:47 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:47 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.457s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:23:47 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] Deleted volume successfully. Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] Acquiring lock "cinder-quobyte-fa4ca224-3e00-4138-9e41-dced6c9be978" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cea52bcc-afd4-4a99-a876-4920504cd835 tempest-VolumesGetTest-1200256954 None] Lock "cinder-060e25be-eb3c-4963-a427-2e04ae0573d4-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-fa4ca224-3e00-4138-9e41-dced6c9be978" acquired by "delete_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8767c7e-1166-4eda-b746-3cea18a0628d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fa4ca224-3e00-4138-9e41-dced6c9be978 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:47 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fa4ca224-3e00-4138-9e41-dced6c9be978 Jul 14 21:23:47 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:48 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9776aeb6-32df-49d3-956c-a17e2167916a 1073741824" returned: 0 in 0.626s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:48 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fa4ca224-3e00-4138-9e41-dced6c9be978" returned: 0 in 0.529s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fa4ca224-3e00-4138-9e41-dced6c9be978 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9776aeb6-32df-49d3-956c-a17e2167916a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:48 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fa4ca224-3e00-4138-9e41-dced6c9be978 Jul 14 21:23:48 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:48 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9776aeb6-32df-49d3-956c-a17e2167916a Jul 14 21:23:48 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:48 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9776aeb6-32df-49d3-956c-a17e2167916a" returned: 0 in 0.435s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:48 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fa4ca224-3e00-4138-9e41-dced6c9be978" returned: 0 in 0.482s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006b574c-5cc5-4c8a-a4fe-93a3b0262131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9776aeb6-32df-49d3-956c-a17e2167916a', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eda5255-f646-4d1d-afae-21561f57b847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-fa4ca224-3e00-4138-9e41-dced6c9be978" released by "delete_volume" :: held 1.078s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:48 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Volume volume-9776aeb6-32df-49d3-956c-a17e2167916a (9776aeb6-32df-49d3-956c-a17e2167916a): created successfully Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eda5255-f646-4d1d-afae-21561f57b847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Flow 'volume_create_manager' (16147e81-7a5c-4269-ba00-941c1eff00c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:48 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-9063bad8-2a77-4e73-80e6-5f933831e74d tempest-VolumesTransfersTest-2110807222 None] Created volume successfully. Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] Created reservations ['08039daa-7b5c-4528-bd78-b4f5ced7650f', '50f8c35f-5ffe-44a0-aa2f-b1e279e939b1', 'ab4594fd-4f93-4b37-b6b1-2d4b70e5140d', '2301c4f5-81aa-4660-8128-4e2632c2c3a2'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:49 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:23:49 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:49 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.308s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:49 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:23:49 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] Deleted volume successfully. Jul 14 21:23:49 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-02135506-69d1-48f6-b20c-91da3eddd0b7 tempest-VolumesGetTest-1200256954 None] Lock "cinder-fa4ca224-3e00-4138-9e41-dced6c9be978-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:50 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-efc76993-47e0-4751-9f7a-21c39d307a9a tempest-VolumesTransfersTest-212111933 None] Transfer volume completed successfully. Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Flow 'volume_create_manager' (951dfe49-74d0-49b5-9541-a197434cef3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c31c55-23a9-4485-b6c5-f34381a55096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c31c55-23a9-4485-b6c5-f34381a55096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-522725223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9b3cad-45da-4135-b516-a2813c6e5fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93c3c83ddf547268ef4de084c3ee49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:50Z,use_quota=True,user_id='a8ace832a1974bb69a080d723d3131ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc538d93-617d-47b1-a1e3-8548be8c4a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc538d93-617d-47b1-a1e3-8548be8c4a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b9f5a3-d121-4406-a7f7-21df63070e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b9f5a3-d121-4406-a7f7-21df63070e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe9b3cad-45da-4135-b516-a2813c6e5fb3', 'volume_name': 'volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56efb29-0601-47b2-8080-ce6006e896e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56efb29-0601-47b2-8080-ce6006e896e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e65e144-cbf5-4298-b574-ad5e634da137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:50 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Volume fe9b3cad-45da-4135-b516-a2813c6e5fb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3', 'volume_size': 1} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-522725223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9b3cad-45da-4135-b516-a2813c6e5fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93c3c83ddf547268ef4de084c3ee49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:50Z,use_quota=True,user_id='a8ace832a1974bb69a080d723d3131ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Creating volume fe9b3cad-45da-4135-b516-a2813c6e5fb3 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:23:50 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:23:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:50 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 1073741824 Jul 14 21:23:50 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:51 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 1073741824" returned: 0 in 0.774s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:51 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 Jul 14 21:23:51 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] Acquiring lock "cinder-9776aeb6-32df-49d3-956c-a17e2167916a-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] Lock "cinder-9776aeb6-32df-49d3-956c-a17e2167916a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] Acquiring lock "cinder-quobyte-9776aeb6-32df-49d3-956c-a17e2167916a" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] Lock "cinder-quobyte-9776aeb6-32df-49d3-956c-a17e2167916a" acquired by "delete_volume" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:51 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb7ad67-298e-4d74-923b-c67ec5f05427]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9776aeb6-32df-49d3-956c-a17e2167916a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:51 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3" returned: 0 in 0.318s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:23:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e65e144-cbf5-4298-b574-ad5e634da137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451fe207-27fa-4d5c-bb26-1c5e0d65a2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:51 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Volume volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 (fe9b3cad-45da-4135-b516-a2813c6e5fb3): created successfully Jul 14 21:23:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451fe207-27fa-4d5c-bb26-1c5e0d65a2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Flow 'volume_create_manager' (951dfe49-74d0-49b5-9541-a197434cef3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:51 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2061964e-9ae2-4319-812b-9694531bd858 tempest-VolumesGetTest-1200256954 None] Created volume successfully. Jul 14 21:23:51 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9776aeb6-32df-49d3-956c-a17e2167916a Jul 14 21:23:51 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:52 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9776aeb6-32df-49d3-956c-a17e2167916a" returned: 0 in 0.389s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9776aeb6-32df-49d3-956c-a17e2167916a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:52 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9776aeb6-32df-49d3-956c-a17e2167916a Jul 14 21:23:52 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:52 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9776aeb6-32df-49d3-956c-a17e2167916a" returned: 0 in 0.255s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] Lock "cinder-quobyte-9776aeb6-32df-49d3-956c-a17e2167916a" released by "delete_volume" :: held 0.693s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:52 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] Created reservations ['ef7a9282-1140-428c-9185-3daba33b380e', '59e99532-c6bc-4793-9894-36c3d905e5f9', 'd38398cd-7537-48e2-b508-24b8f3aee094', '5541b063-554a-4a53-a903-0ce2d4ed9f0a'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:52 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:23:52 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:52 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.325s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:52 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:23:52 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] Deleted volume successfully. Jul 14 21:23:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-971283ca-9b9c-41bb-95e4-a024a56892a0 tempest-VolumesTransfersTest-1431548923 None] Lock "cinder-9776aeb6-32df-49d3-956c-a17e2167916a-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Flow 'volume_create_manager' (598faf42-c945-450e-acf5-68d76e1b0c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d9fe4d-696c-40a0-bd5c-782f7a1744b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Flow 'volume_create_manager' (96a117e9-4ce2-4ab6-81e1-d9f5f09bc1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77317a6-e923-4301-925f-ed833d6be111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d9fe4d-696c-40a0-bd5c-782f7a1744b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2119401365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad49068-b0cf-4e9c-9a2e-941d77ed34bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0298b70fa81246cab3f83645a1c75368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:53Z,use_quota=True,user_id='20aa0e3c8dde41b6b7ac8a086846daa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fd7d75-66a5-481b-a306-84a56dea6439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fd7d75-66a5-481b-a306-84a56dea6439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7bd246-208f-4333-947a-db7ac4be897f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7bd246-208f-4333-947a-db7ac4be897f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ad49068-b0cf-4e9c-9a2e-941d77ed34bb', 'volume_name': 'volume-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8474f834-330f-4071-b445-fd571e608cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8474f834-330f-4071-b445-fd571e608cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa44aec-98ff-45eb-9ad6-1ced1992b9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:53 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Volume 3ad49068-b0cf-4e9c-9a2e-941d77ed34bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb', 'volume_size': 1} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2119401365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad49068-b0cf-4e9c-9a2e-941d77ed34bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0298b70fa81246cab3f83645a1c75368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:53Z,use_quota=True,user_id='20aa0e3c8dde41b6b7ac8a086846daa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Creating volume 3ad49068-b0cf-4e9c-9a2e-941d77ed34bb {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:23:53 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77317a6-e923-4301-925f-ed833d6be111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1944977314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec6edea-3d20-4f6a-aaee-68879ba4d3e2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e93c3c83ddf547268ef4de084c3ee49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=fe9b3cad-45da-4135-b516-a2813c6e5fb3,status='creating',terminated_at=None,updated_at=2026-07-14T19:23:53Z,use_quota=True,user_id='a8ace832a1974bb69a080d723d3131ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8f5494-801f-4ac1-b17f-763ae24c6159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:53 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb 1073741824 Jul 14 21:23:53 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8f5494-801f-4ac1-b17f-763ae24c6159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cfb6587-20f0-466e-ba6c-5674b1ea0859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cfb6587-20f0-466e-ba6c-5674b1ea0859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6ec6edea-3d20-4f6a-aaee-68879ba4d3e2', 'volume_name': 'volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2', 'volume_size': 1, 'source_volid': 'fe9b3cad-45da-4135-b516-a2813c6e5fb3', 'source_volstatus': 'available'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b770e83b-2a2e-424b-bbdd-5c14d6986692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b770e83b-2a2e-424b-bbdd-5c14d6986692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6780018-cd7d-4346-80f9-66b362291afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:53 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Volume 6ec6edea-3d20-4f6a-aaee-68879ba4d3e2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2', 'volume_size': 1, 'source_volid': 'fe9b3cad-45da-4135-b516-a2813c6e5fb3', 'source_volstatus': 'available'} Jul 14 21:23:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:54 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb 1073741824" returned: 0 in 0.580s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:54 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb Jul 14 21:23:54 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:54 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb" returned: 0 in 0.311s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:23:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.811s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:54 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Cloning volume fe9b3cad-45da-4135-b516-a2813c6e5fb3 to volume 6ec6edea-3d20-4f6a-aaee-68879ba4d3e2 Jul 14 21:23:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa44aec-98ff-45eb-9ad6-1ced1992b9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb70630-5f5a-4812-9326-a56242bbab5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:23:54 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Volume volume-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb (3ad49068-b0cf-4e9c-9a2e-941d77ed34bb): created successfully Jul 14 21:23:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb70630-5f5a-4812-9326-a56242bbab5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:23:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Flow 'volume_create_manager' (598faf42-c945-450e-acf5-68d76e1b0c0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:23:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Creating offline snapshot 12c69e06-d8af-4480-b0e2-65a00d2ddd10 of volume fe9b3cad-45da-4135-b516-a2813c6e5fb3 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:23:54 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-6dbd9b63-3241-4dfe-9ab4-900a6cc1cd9d tempest-VolumesTransfersTest-2110807222 None] Created volume successfully. Jul 14 21:23:54 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[617965e9-8b94-4a0c-bc58-754cb9b46c8e]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:54 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 Jul 14 21:23:54 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:54 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3" returned: 0 in 0.407s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:55 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10 1G Jul 14 21:23:55 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:55 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10 1G" returned: 0 in 0.683s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:55 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10 Jul 14 21:23:55 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] Acquiring lock "cinder-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] Lock "cinder-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] Acquiring lock "cinder-quobyte-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] Lock "cinder-quobyte-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb" acquired by "delete_volume" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:56 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[612131ab-17a7-405c-9dd3-b8a789af0948]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:56 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10" returned: 0 in 0.537s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:56 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10 is being set with open permissions: ugo+rw Jul 14 21:23:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:56 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb Jul 14 21:23:56 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:56 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10 Jul 14 21:23:56 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:56 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb" returned: 0 in 0.561s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:56 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10" returned: 0 in 0.418s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:56 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb Jul 14 21:23:56 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:56 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.info Jul 14 21:23:56 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:57 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb" returned: 0 in 0.409s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] Lock "cinder-quobyte-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb" released by "delete_volume" :: held 1.030s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:57 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.info" returned: 0 in 0.401s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:57 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.info is being set with open permissions: ugo+rw Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] Created reservations ['85705ce1-8b30-40e9-9381-d573cd7de43a', '84575848-3814-4d77-b93e-0c6fe08c8631', 'f6d1c4f9-fd52-46cd-b86b-a0f0c2f702f6', '45d9bc7b-a066-4894-ac98-7acbe462d578'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:23:57 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.info Jul 14 21:23:57 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:57 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:23:57 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:57 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.info" returned: 0 in 0.336s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Acquiring lock "cinder-quobyte-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2" by "_copy_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] snapshot: 12c69e06-d8af-4480-b0e2-65a00d2ddd10, volume: 6ec6edea-3d20-4f6a-aaee-68879ba4d3e2, {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:23:57 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f1db03-f09d-4b4c-a3f3-b6f638368b59]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.323s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:23:57 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] Deleted volume successfully. Jul 14 21:23:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-793f73f2-b491-41cb-9d7a-f1c821f93c14 tempest-VolumesTransfersTest-1431548923 None] Lock "cinder-3ad49068-b0cf-4e9c-9a2e-941d77ed34bb-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:23:57 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10 Jul 14 21:23:57 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:58 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10" returned: 0 in 0.463s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:23:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 21:23:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Creating direct copy from snapshot {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 21:23:58 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1918a925-9c9a-472c-b84b-32e335c2a975]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:23:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:58 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 Jul 14 21:23:58 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:23:58 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Jul 14 21:23:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3" returned: 0 in 0.556s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:23:58 devstack cinder-volume[88300]: DEBUG cinder.utils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Path /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2 not found in is_blk_device check {{(pid=88300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 21:23:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:23:58 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2 Jul 14 21:23:58 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:05 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2" returned: 0 in 7.006s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:05 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4638786d-6bb0-4efc-8f17-dcdaf24dce34]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:05 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 Jul 14 21:24:05 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:06 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3" returned: 0 in 0.653s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:06 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Image conversion details: src /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2 {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:24:06 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Converted 1024.00 MB image at 146.10 MB/s Jul 14 21:24:06 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2 is being set with open permissions: ugo+rw Jul 14 21:24:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:06 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2 Jul 14 21:24:06 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:06 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2" returned: 0 in 0.350s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2" released by "_copy_volume_from_snapshot" :: held 9.158s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Acquiring lock "cinder-quobyte-12c69e06-d8af-4480-b0e2-65a00d2ddd10" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-12c69e06-d8af-4480-b0e2-65a00d2ddd10" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Deleting offline snapshot 12c69e06-d8af-4480-b0e2-65a00d2ddd10 of volume fe9b3cad-45da-4135-b516-a2813c6e5fb3 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:24:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] snapshot_file for this snap is: volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:24:06 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eece83-de7c-4a54-8c85-f7b5997a17ae]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:06 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10 Jul 14 21:24:06 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:07 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10" returned: 0 in 0.568s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:24:07 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a079cb9-87cb-47d1-8a62-8087e21d7347]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:07 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 Jul 14 21:24:07 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:07 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:INSERT=28,cinder:UPDATE=134,cinder:SELECT=106,cinder:DELETE=16 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:24:07 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3" returned: 0 in 0.453s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:07 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10 Jul 14 21:24:07 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:08 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10" returned: 0 in 0.507s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:08 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10 Jul 14 21:24:08 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:08 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3.12c69e06-d8af-4480-b0e2-65a00d2ddd10" returned: 0 in 0.378s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:08 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-12c69e06-d8af-4480-b0e2-65a00d2ddd10" released by "_delete_snapshot" :: held 2.021s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.270s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6780018-cd7d-4346-80f9-66b362291afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2', 'volume_size': 1, 'source_volid': 'fe9b3cad-45da-4135-b516-a2813c6e5fb3', 'source_volstatus': 'available'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863bea56-1e2e-4e36-8a76-7d0e5122d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:08 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Volume volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2 (6ec6edea-3d20-4f6a-aaee-68879ba4d3e2): created successfully Jul 14 21:24:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863bea56-1e2e-4e36-8a76-7d0e5122d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Flow 'volume_create_manager' (96a117e9-4ce2-4ab6-81e1-d9f5f09bc1f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:08 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-cc54de96-08f6-468e-8acd-a9ce00e7d4a8 tempest-VolumesGetTest-1200256954 None] Created volume successfully. Jul 14 21:24:08 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a42c9153-62db-4a19-b6f6-6a42a2f7d1b5 tempest-GroupsV320Test-1909878709 None] Group tempest-GroupsV320Test-Group-2121319465: creating Jul 14 21:24:08 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a42c9153-62db-4a19-b6f6-6a42a2f7d1b5 tempest-GroupsV320Test-1909878709 None] Group tempest-GroupsV320Test-Group-2121319465: created successfully Jul 14 21:24:08 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a42c9153-62db-4a19-b6f6-6a42a2f7d1b5 tempest-GroupsV320Test-1909878709 None] Create group completed successfully. Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Flow 'volume_create_manager' (e6ba07fe-c926-448e-9ef7-87996123f9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c37161-3a3d-483a-9344-c957fc12bf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c37161-3a3d-483a-9344-c957fc12bf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1855156473',display_name='tempest-VolumesGetTest-Volume-112081858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d99aa1-2e42-4b3f-9420-558665a60efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93c3c83ddf547268ef4de084c3ee49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:10Z,use_quota=True,user_id='a8ace832a1974bb69a080d723d3131ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e59f5e-6fc1-4997-bc4f-2433c98c2138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e59f5e-6fc1-4997-bc4f-2433c98c2138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af0b342-0fc7-45ab-95e8-4a7755706da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af0b342-0fc7-45ab-95e8-4a7755706da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9d99aa1-2e42-4b3f-9420-558665a60efc', 'volume_name': 'volume-c9d99aa1-2e42-4b3f-9420-558665a60efc', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c713edf-cd38-4fe3-92da-18d99c2005a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c713edf-cd38-4fe3-92da-18d99c2005a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1aef7e-3064-4da8-b1cd-7611e9953fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:09 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Volume c9d99aa1-2e42-4b3f-9420-558665a60efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9d99aa1-2e42-4b3f-9420-558665a60efc', 'volume_size': 1} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1855156473',display_name='tempest-VolumesGetTest-Volume-112081858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d99aa1-2e42-4b3f-9420-558665a60efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93c3c83ddf547268ef4de084c3ee49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:10Z,use_quota=True,user_id='a8ace832a1974bb69a080d723d3131ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Creating volume c9d99aa1-2e42-4b3f-9420-558665a60efc {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:24:09 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:24:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c9d99aa1-2e42-4b3f-9420-558665a60efc 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:09 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c9d99aa1-2e42-4b3f-9420-558665a60efc 1073741824 Jul 14 21:24:09 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:10 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c9d99aa1-2e42-4b3f-9420-558665a60efc 1073741824" returned: 0 in 0.485s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c9d99aa1-2e42-4b3f-9420-558665a60efc {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:10 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c9d99aa1-2e42-4b3f-9420-558665a60efc Jul 14 21:24:10 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-186e85c6-da0c-4eed-86a6-eedbb1342db1 tempest-GroupsV320Test-1909878709 None] Created reservations ['f5aba47c-4a2d-4206-aa85-6384b16b7841'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-186e85c6-da0c-4eed-86a6-eedbb1342db1 tempest-GroupsV320Test-1909878709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-186e85c6-da0c-4eed-86a6-eedbb1342db1 tempest-GroupsV320Test-1909878709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-186e85c6-da0c-4eed-86a6-eedbb1342db1 tempest-GroupsV320Test-1909878709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-186e85c6-da0c-4eed-86a6-eedbb1342db1 tempest-GroupsV320Test-1909878709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-186e85c6-da0c-4eed-86a6-eedbb1342db1 tempest-GroupsV320Test-1909878709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-186e85c6-da0c-4eed-86a6-eedbb1342db1 tempest-GroupsV320Test-1909878709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:10 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:24:10 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:10 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c9d99aa1-2e42-4b3f-9420-558665a60efc" returned: 0 in 0.336s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1aef7e-3064-4da8-b1cd-7611e9953fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9d99aa1-2e42-4b3f-9420-558665a60efc', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69fd604b-75c5-4c78-a212-888e8b4844e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=121,cinder:INSERT=42,cinder:UPDATE=166,cinder:DELETE=8 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:24:10 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Volume volume-c9d99aa1-2e42-4b3f-9420-558665a60efc (c9d99aa1-2e42-4b3f-9420-558665a60efc): created successfully Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69fd604b-75c5-4c78-a212-888e8b4844e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Flow 'volume_create_manager' (e6ba07fe-c926-448e-9ef7-87996123f9e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:10 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-8cfa156d-7468-465e-b634-302d75db80f2 tempest-VolumesGetTest-1200256954 None] Created volume successfully. Jul 14 21:24:10 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-186e85c6-da0c-4eed-86a6-eedbb1342db1 tempest-GroupsV320Test-1909878709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.289s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-186e85c6-da0c-4eed-86a6-eedbb1342db1 tempest-GroupsV320Test-1909878709 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:24:10 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-186e85c6-da0c-4eed-86a6-eedbb1342db1 tempest-GroupsV320Test-1909878709 None] Delete group completed successfully. Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Flow 'volume_create_manager' (34b0a69d-c519-40d9-b915-abf028accd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7e8474-92d9-44e8-8513-38febb7940ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7e8474-92d9-44e8-8513-38febb7940ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1083953162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2292070b-c10f-4371-95dc-8f2475afaadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cc000bb4b0b41ab8121cc28561f1cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:11Z,use_quota=True,user_id='556a3e655f21451ab04d7ddfc1e4a008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b2bba3-d367-4f41-b571-89b90178f4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b2bba3-d367-4f41-b571-89b90178f4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d380b1-e7ba-4861-aa0c-762700a42bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d380b1-e7ba-4861-aa0c-762700a42bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2292070b-c10f-4371-95dc-8f2475afaadb', 'volume_name': 'volume-2292070b-c10f-4371-95dc-8f2475afaadb', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ad6d76-f1be-4078-ab3d-c2c4c6180224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ad6d76-f1be-4078-ab3d-c2c4c6180224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6dcdc09-76ea-49c9-911d-e6da11764413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:10 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Volume 2292070b-c10f-4371-95dc-8f2475afaadb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2292070b-c10f-4371-95dc-8f2475afaadb', 'volume_size': 1} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1083953162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2292070b-c10f-4371-95dc-8f2475afaadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cc000bb4b0b41ab8121cc28561f1cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:11Z,use_quota=True,user_id='556a3e655f21451ab04d7ddfc1e4a008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Creating volume 2292070b-c10f-4371-95dc-8f2475afaadb {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:24:10 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:24:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2292070b-c10f-4371-95dc-8f2475afaadb 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:11 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2292070b-c10f-4371-95dc-8f2475afaadb 1073741824 Jul 14 21:24:11 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:11 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2292070b-c10f-4371-95dc-8f2475afaadb 1073741824" returned: 0 in 0.402s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2292070b-c10f-4371-95dc-8f2475afaadb {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:11 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2292070b-c10f-4371-95dc-8f2475afaadb Jul 14 21:24:11 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:11 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2292070b-c10f-4371-95dc-8f2475afaadb" returned: 0 in 0.250s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:11 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:24:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6dcdc09-76ea-49c9-911d-e6da11764413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2292070b-c10f-4371-95dc-8f2475afaadb', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4046b491-c5fc-4cb5-894b-4dc73983fac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:11 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Volume volume-2292070b-c10f-4371-95dc-8f2475afaadb (2292070b-c10f-4371-95dc-8f2475afaadb): created successfully Jul 14 21:24:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4046b491-c5fc-4cb5-894b-4dc73983fac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:11 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Flow 'volume_create_manager' (34b0a69d-c519-40d9-b915-abf028accd59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:11 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f66b0a63-9541-419a-9175-13b084576a38 tempest-VolumesTransfersV355Test-160419949 None] Created volume successfully. Jul 14 21:24:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] Acquiring lock "cinder-c9d99aa1-2e42-4b3f-9420-558665a60efc-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] Lock "cinder-c9d99aa1-2e42-4b3f-9420-558665a60efc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] Acquiring lock "cinder-quobyte-c9d99aa1-2e42-4b3f-9420-558665a60efc" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-c9d99aa1-2e42-4b3f-9420-558665a60efc" acquired by "delete_volume" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:12 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2378e718-815a-4f6a-9652-1957a78c1a94]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c9d99aa1-2e42-4b3f-9420-558665a60efc {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:12 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c9d99aa1-2e42-4b3f-9420-558665a60efc Jul 14 21:24:12 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:12 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c9d99aa1-2e42-4b3f-9420-558665a60efc" returned: 0 in 0.393s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c9d99aa1-2e42-4b3f-9420-558665a60efc {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:12 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c9d99aa1-2e42-4b3f-9420-558665a60efc Jul 14 21:24:12 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:12 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-ee173d16-78e1-4501-949b-1bcfb1dfd09f tempest-VolumesTransfersV355Test-332713528 None] Transfer volume completed successfully. Jul 14 21:24:12 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c9d99aa1-2e42-4b3f-9420-558665a60efc" returned: 0 in 0.258s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-c9d99aa1-2e42-4b3f-9420-558665a60efc" released by "delete_volume" :: held 0.701s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:12 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] Created reservations ['7fb7376e-40c6-49c8-807e-b9bbc63c191b', '2b5adbf8-08c0-4220-bf03-0c46caad072f', '4b4365e3-0b9c-4ccd-ae8e-2f452a5cf59e', '5cf00335-87d8-4764-927c-c85c19f041e9'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:24:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:12 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:24:12 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:13 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.291s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:24:13 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] Deleted volume successfully. Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] Acquiring lock "cinder-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-538c6491-e4cb-4000-8d82-05f359370ba5 tempest-VolumesGetTest-1200256954 None] Lock "cinder-c9d99aa1-2e42-4b3f-9420-558665a60efc-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] Lock "cinder-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] Acquiring lock "cinder-quobyte-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2" acquired by "delete_volume" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] Acquiring lock "cinder-2292070b-c10f-4371-95dc-8f2475afaadb-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b94c196-4d8c-4dc1-836e-2cbd7a0ca483]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] Lock "cinder-2292070b-c10f-4371-95dc-8f2475afaadb-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] Acquiring lock "cinder-quobyte-2292070b-c10f-4371-95dc-8f2475afaadb" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] Lock "cinder-quobyte-2292070b-c10f-4371-95dc-8f2475afaadb" acquired by "delete_volume" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6e5a70-76a4-4ace-b9f1-f2ddde7e9c45]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2292070b-c10f-4371-95dc-8f2475afaadb {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:13 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2 Jul 14 21:24:13 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:13 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2292070b-c10f-4371-95dc-8f2475afaadb Jul 14 21:24:13 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:13 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2" returned: 0 in 0.466s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:13 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2 Jul 14 21:24:13 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:13 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2292070b-c10f-4371-95dc-8f2475afaadb" returned: 0 in 0.412s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2292070b-c10f-4371-95dc-8f2475afaadb {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:14 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2292070b-c10f-4371-95dc-8f2475afaadb Jul 14 21:24:14 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:14 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2" returned: 0 in 0.281s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2" released by "delete_volume" :: held 0.821s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:14 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2292070b-c10f-4371-95dc-8f2475afaadb" returned: 0 in 0.263s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] Created reservations ['87d1f228-7335-498c-8d93-5907f454cabd', 'dbb924b6-5f34-48b3-a20e-7a588b1233bb', '8d21d5f9-2823-4b0d-b475-f6c464b49ad9', '2708db41-5d6b-4b44-80bc-1c9a753c138f'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] Lock "cinder-quobyte-2292070b-c10f-4371-95dc-8f2475afaadb" released by "delete_volume" :: held 0.727s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] Created reservations ['18c97d7c-d904-4c0c-abb3-e07997784593', 'dab77563-1e52-42c2-9a4f-e3bbd77b7318', 'c04a75c3-29ca-4bc4-8c1f-0dd6dc8d218f', 'baa62a74-0942-48d6-8169-dfef2888eaf8'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:24:14 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:24:14 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:14 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:24:14 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] Acquiring lock "cinder-fe9b3cad-45da-4135-b516-a2813c6e5fb3-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] Lock "cinder-fe9b3cad-45da-4135-b516-a2813c6e5fb3-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:14 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.405s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:24:14 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] Deleted volume successfully. Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] Acquiring lock "cinder-quobyte-fe9b3cad-45da-4135-b516-a2813c6e5fb3" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e8348af8-1715-4626-8324-ec3d0600a4b9 tempest-VolumesGetTest-1200256954 None] Lock "cinder-6ec6edea-3d20-4f6a-aaee-68879ba4d3e2-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-fe9b3cad-45da-4135-b516-a2813c6e5fb3" acquired by "delete_volume" :: waited 0.034s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[931479b0-3850-4f65-b4bc-aa994ecc0f29]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:14 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.391s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:14 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:24:14 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] Deleted volume successfully. Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-731e2459-6545-4986-9b64-1916449c594e tempest-VolumesTransfersV355Test-386744875 None] Lock "cinder-2292070b-c10f-4371-95dc-8f2475afaadb-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:15 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 Jul 14 21:24:15 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:24:15 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Flow 'volume_create_manager' (9029f037-dbfa-4418-8e01-73bc6d0c3e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae48b0a-f031-4445-98ca-bfef211cbe67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3" returned: 0 in 0.584s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae48b0a-f031-4445-98ca-bfef211cbe67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1641083547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86630649-fcc5-4fd7-8fef-d53761e40b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cc000bb4b0b41ab8121cc28561f1cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:15Z,use_quota=True,user_id='556a3e655f21451ab04d7ddfc1e4a008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ff694b-05f9-41a4-9d7b-96bec2ae3ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:15 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3 Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ff694b-05f9-41a4-9d7b-96bec2ae3ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:15 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867e859f-b852-401f-b143-1b41ed3e3a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867e859f-b852-401f-b143-1b41ed3e3a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86630649-fcc5-4fd7-8fef-d53761e40b2a', 'volume_name': 'volume-86630649-fcc5-4fd7-8fef-d53761e40b2a', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69055ac-a0f5-4e38-ae9d-7a5e98e2aef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69055ac-a0f5-4e38-ae9d-7a5e98e2aef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a2a375-7194-43fc-b2c3-6c0ff2867e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:15 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Volume 86630649-fcc5-4fd7-8fef-d53761e40b2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86630649-fcc5-4fd7-8fef-d53761e40b2a', 'volume_size': 1} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1641083547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86630649-fcc5-4fd7-8fef-d53761e40b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cc000bb4b0b41ab8121cc28561f1cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:15Z,use_quota=True,user_id='556a3e655f21451ab04d7ddfc1e4a008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Creating volume 86630649-fcc5-4fd7-8fef-d53761e40b2a {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:24:15 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-86630649-fcc5-4fd7-8fef-d53761e40b2a 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:15 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-86630649-fcc5-4fd7-8fef-d53761e40b2a 1073741824 Jul 14 21:24:15 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:15 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-fe9b3cad-45da-4135-b516-a2813c6e5fb3" returned: 0 in 0.327s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-fe9b3cad-45da-4135-b516-a2813c6e5fb3" released by "delete_volume" :: held 1.022s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:15 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] Created reservations ['2ac4ec91-8902-4414-84ea-2cf89db6070a', '076e7758-35fa-44cc-a18e-4110f03142f0', '9f42519f-8def-46e8-8fde-6654aba796e9', '6c1f2c34-8d40-4390-8311-cc226b5e5fa8'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:16 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:24:16 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:16 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-86630649-fcc5-4fd7-8fef-d53761e40b2a 1073741824" returned: 0 in 0.677s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:16 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.301s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:24:16 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] Deleted volume successfully. Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-86630649-fcc5-4fd7-8fef-d53761e40b2a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f78c082a-aba4-4cfa-8049-d48094dc5016 tempest-VolumesGetTest-1200256954 None] Lock "cinder-fe9b3cad-45da-4135-b516-a2813c6e5fb3-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:16 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-86630649-fcc5-4fd7-8fef-d53761e40b2a Jul 14 21:24:16 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:16 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-86630649-fcc5-4fd7-8fef-d53761e40b2a" returned: 0 in 0.332s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a2a375-7194-43fc-b2c3-6c0ff2867e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86630649-fcc5-4fd7-8fef-d53761e40b2a', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777079d8-0c3b-46e6-b94a-cc58b1613353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:16 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Volume volume-86630649-fcc5-4fd7-8fef-d53761e40b2a (86630649-fcc5-4fd7-8fef-d53761e40b2a): created successfully Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777079d8-0c3b-46e6-b94a-cc58b1613353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Flow 'volume_create_manager' (9029f037-dbfa-4418-8e01-73bc6d0c3e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:16 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-49f4c5bf-ceb8-4eb6-87b1-6c2ec3a7e7f4 tempest-VolumesTransfersV355Test-160419949 None] Created volume successfully. Jul 14 21:24:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] Acquiring lock "cinder-86630649-fcc5-4fd7-8fef-d53761e40b2a-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] Lock "cinder-86630649-fcc5-4fd7-8fef-d53761e40b2a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] Acquiring lock "cinder-quobyte-86630649-fcc5-4fd7-8fef-d53761e40b2a" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] Lock "cinder-quobyte-86630649-fcc5-4fd7-8fef-d53761e40b2a" acquired by "delete_volume" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:18 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a09e13-939d-475a-8046-be9461035172]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-86630649-fcc5-4fd7-8fef-d53761e40b2a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:18 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:24:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Flow 'volume_create_manager' (f811c1ed-385f-4ecd-abdf-3d2bea0f9100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12bc37e-b1c0-42d2-8a34-16b0c10ed072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12bc37e-b1c0-42d2-8a34-16b0c10ed072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1500848884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=239f55c0-2140-4afc-81f6-e988f1267a91,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e93c3c83ddf547268ef4de084c3ee49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:18Z,use_quota=True,user_id='a8ace832a1974bb69a080d723d3131ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233ea263-bfb7-4524-8665-171afae041ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233ea263-bfb7-4524-8665-171afae041ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:18 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-86630649-fcc5-4fd7-8fef-d53761e40b2a Jul 14 21:24:18 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f28736-d0c3-4fd2-8928-389f31c02ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:18 devstack cinder-volume[88300]: DEBUG cinder.image.glance [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Creating Keystone auth plugin from conf {{(pid=88300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 21:24:19 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-86630649-fcc5-4fd7-8fef-d53761e40b2a" returned: 0 in 0.483s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-86630649-fcc5-4fd7-8fef-d53761e40b2a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:19 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-86630649-fcc5-4fd7-8fef-d53761e40b2a Jul 14 21:24:19 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f28736-d0c3-4fd2-8928-389f31c02ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '239f55c0-2140-4afc-81f6-e988f1267a91', 'volume_name': 'volume-239f55c0-2140-4afc-81f6-e988f1267a91', 'volume_size': 1, 'image_id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31d13bd45fbb466f90c2faf198257b79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'created_at': datetime.datetime(2026, 7, 14, 19, 8, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 8, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9584f4-0dab-4f40-84f7-0c194ff831a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9584f4-0dab-4f40-84f7-0c194ff831a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1bb82a-1c41-467d-bae4-7529f2b94401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:19 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Volume 239f55c0-2140-4afc-81f6-e988f1267a91: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-239f55c0-2140-4afc-81f6-e988f1267a91', 'volume_size': 1, 'image_id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31d13bd45fbb466f90c2faf198257b79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'created_at': datetime.datetime(2026, 7, 14, 19, 8, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 8, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Trying to clone 239f55c0-2140-4afc-81f6-e988f1267a91 from image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}]). {{(pid=88300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:24:19 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Flow 'volume_create_manager' (1afc7100-a7a8-450f-a9ab-0e1d91294fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be73bf33-1bea-4e47-b7e2-b3bb009eb3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-86630649-fcc5-4fd7-8fef-d53761e40b2a" returned: 0 in 0.419s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be73bf33-1bea-4e47-b7e2-b3bb009eb3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-246889492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5885685c-bff5-42fe-a214-fe3d26594d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac77b9a4be964d528357f4591fa07247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:19Z,use_quota=True,user_id='bfcb4c2658ab47779c5d89976420de2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ab4fc21-606a-433a-bb76-0a7aeedca909),volume_type_id=4ab4fc21-606a-433a-bb76-0a7aeedca909)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecce5630-17aa-4f2c-81e9-f5da7d013071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecce5630-17aa-4f2c-81e9-f5da7d013071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55683b8a-8920-4749-91c7-b3a074ebb7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55683b8a-8920-4749-91c7-b3a074ebb7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5885685c-bff5-42fe-a214-fe3d26594d03', 'volume_name': 'volume-5885685c-bff5-42fe-a214-fe3d26594d03', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2096bee-0517-45e7-8b47-b60d8dec82e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2096bee-0517-45e7-8b47-b60d8dec82e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4e4579-73ca-4641-b30e-3784db7f418f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:19 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Volume 5885685c-bff5-42fe-a214-fe3d26594d03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5885685c-bff5-42fe-a214-fe3d26594d03', 'volume_size': 1} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-246889492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5885685c-bff5-42fe-a214-fe3d26594d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac77b9a4be964d528357f4591fa07247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:19Z,use_quota=True,user_id='bfcb4c2658ab47779c5d89976420de2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ab4fc21-606a-433a-bb76-0a7aeedca909),volume_type_id=4ab4fc21-606a-433a-bb76-0a7aeedca909)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Creating volume 5885685c-bff5-42fe-a214-fe3d26594d03 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:24:19 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5885685c-bff5-42fe-a214-fe3d26594d03 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] Lock "cinder-quobyte-86630649-fcc5-4fd7-8fef-d53761e40b2a" released by "delete_volume" :: held 1.107s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:19 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5885685c-bff5-42fe-a214-fe3d26594d03 1073741824 Jul 14 21:24:19 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] Created reservations ['3094da13-1b5e-4edb-8393-0144432b7cb9', '5243b98e-ac8f-482d-bace-604172aa64cc', 'd6a0668c-d566-49d8-82cf-5d27da55bfc8', '354ab9b0-dd66-42a6-ba40-47eddcc1ef05'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_b7tiyrucdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 21:24:19 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Image download 20.69 MB at 20.69 MB/s Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:20 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f92e17-8d5f-4621-a36e-c6e926759527]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_b7tiyrucdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:20 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:20 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_b7tiyrucdevstack@QuobyteHD Jul 14 21:24:20 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:20 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5885685c-bff5-42fe-a214-fe3d26594d03 1073741824" returned: 0 in 0.756s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5885685c-bff5-42fe-a214-fe3d26594d03 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:20 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.464s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:24:20 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5885685c-bff5-42fe-a214-fe3d26594d03 Jul 14 21:24:20 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:20 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] Deleted volume successfully. Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b81b2119-8175-46d5-a2e0-660a34f5adb7 tempest-VolumesTransfersV355Test-386744875 None] Lock "cinder-86630649-fcc5-4fd7-8fef-d53761e40b2a-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:20 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_b7tiyrucdevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Temporary image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 is fetched for user a8ace832a1974bb69a080d723d3131ba. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7217aa9-198c-412b-81e8-0388cc64c609]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_b7tiyrucdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:20 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-8c4cee00-86f2-4741-8161-87ab272bf87c req-e17c1b0c-bf15-4957-acf4-444f34600db8 tempest-TestMinimumBasicScenario-1290309383 None] Terminate volume connection completed successfully. Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-8c4cee00-86f2-4741-8161-87ab272bf87c req-e17c1b0c-bf15-4957-acf4-444f34600db8 tempest-TestMinimumBasicScenario-1290309383 None] Deleting attachment 71ab1995-7e81-4321-af43-60543547ebc6. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:24:20 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5885685c-bff5-42fe-a214-fe3d26594d03" returned: 0 in 0.350s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:20 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_b7tiyrucdevstack@QuobyteHD Jul 14 21:24:20 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4e4579-73ca-4641-b30e-3784db7f418f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5885685c-bff5-42fe-a214-fe3d26594d03', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9953a146-b41d-4664-a96b-dab83d6d1ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:20 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Volume volume-5885685c-bff5-42fe-a214-fe3d26594d03 (5885685c-bff5-42fe-a214-fe3d26594d03): created successfully Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9953a146-b41d-4664-a96b-dab83d6d1ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Flow 'volume_create_manager' (1afc7100-a7a8-450f-a9ab-0e1d91294fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:20 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-08fc0b5d-bdf9-489d-867a-b38e51911b9a tempest-VolumeTypesAccessTest-1870110112 None] Created volume successfully. Jul 14 21:24:21 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_b7tiyrucdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1500848884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=239f55c0-2140-4afc-81f6-e988f1267a91,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e93c3c83ddf547268ef4de084c3ee49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:18Z,use_quota=True,user_id='a8ace832a1974bb69a080d723d3131ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Creating volume 239f55c0-2140-4afc-81f6-e988f1267a91 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:24:21 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:21 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 1073741824 Jul 14 21:24:21 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] Acquiring lock "cinder-3782f048-b94c-4c91-a617-3eae2356a66c-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] Lock "cinder-3782f048-b94c-4c91-a617-3eae2356a66c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] Acquiring lock "cinder-quobyte-3782f048-b94c-4c91-a617-3eae2356a66c" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] Lock "cinder-quobyte-3782f048-b94c-4c91-a617-3eae2356a66c" acquired by "delete_volume" :: waited 0.022s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:21 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 1073741824" returned: 0 in 0.534s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3015b79b-e44c-446c-b0a5-13f0d512a032]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3782f048-b94c-4c91-a617-3eae2356a66c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Acquiring lock "cinder-5885685c-bff5-42fe-a214-fe3d26594d03-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Lock "cinder-5885685c-bff5-42fe-a214-fe3d26594d03-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:21 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 Jul 14 21:24:21 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Acquiring lock "cinder-quobyte-5885685c-bff5-42fe-a214-fe3d26594d03" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:21 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3782f048-b94c-4c91-a617-3eae2356a66c Jul 14 21:24:21 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Lock "cinder-quobyte-5885685c-bff5-42fe-a214-fe3d26594d03" acquired by "delete_volume" :: waited 0.022s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26af331-10ea-44b5-a038-5a231e7482e4]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5885685c-bff5-42fe-a214-fe3d26594d03 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:21 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5885685c-bff5-42fe-a214-fe3d26594d03 Jul 14 21:24:21 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:21 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91" returned: 0 in 0.309s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:21 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Attempting download of 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}])) to volume 239f55c0-2140-4afc-81f6-e988f1267a91. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 21:24:22 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3782f048-b94c-4c91-a617-3eae2356a66c" returned: 0 in 0.470s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3782f048-b94c-4c91-a617-3eae2356a66c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfaf0d2-d08c-4319-9832-bd3b002f2449]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_buylljpe {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:22 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3782f048-b94c-4c91-a617-3eae2356a66c Jul 14 21:24:22 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:22 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_buylljpe Jul 14 21:24:22 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:22 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5885685c-bff5-42fe-a214-fe3d26594d03" returned: 0 in 0.461s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5885685c-bff5-42fe-a214-fe3d26594d03 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:22 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5885685c-bff5-42fe-a214-fe3d26594d03 Jul 14 21:24:22 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:22 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3782f048-b94c-4c91-a617-3eae2356a66c" returned: 0 in 0.335s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] Lock "cinder-quobyte-3782f048-b94c-4c91-a617-3eae2356a66c" released by "delete_volume" :: held 0.882s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] Created reservations ['37108086-f162-4fbb-8359-50ac5434f0b4', 'a1fc957b-1e0e-4c19-a1ce-b6cd6d636bcc', '51c25a2d-7b0d-4e5d-961d-4ed8f72452d5', '759c1b8c-a891-456b-873f-24edc49076ad'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:24:22 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_buylljpe" returned: 0 in 0.426s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_buylljpe {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:22 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5885685c-bff5-42fe-a214-fe3d26594d03" returned: 0 in 0.283s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Lock "cinder-quobyte-5885685c-bff5-42fe-a214-fe3d26594d03" released by "delete_volume" :: held 0.798s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:22 devstack cinder-volume[88300]: WARNING cinder.quota [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-70153729 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-70153729, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:24:22 devstack cinder-volume[88300]: WARNING cinder.quota [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-70153729 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-70153729, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:22 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_buylljpe Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Created reservations ['d6e7fe2a-c58f-48f3-b087-ffabbaacc216', '9ff90559-849c-4105-b1c0-4255d473d19a', '251c8020-1414-4750-9215-0fdc2d5c33f7', '2ac6e2f1-92ce-4e0e-8dd9-9298836329ba'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:24:22 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:22 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:24:22 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:22 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:24:22 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:23 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.515s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:23 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:24:23 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:23 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] Deleted volume successfully. Jul 14 21:24:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_buylljpe" returned: 1 in 0.675s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_buylljpe' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:24:23 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6293155-2d88-492e-bdab-b1fa5e6157d0]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_b7tiyrucdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:23 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-db422a84-5034-4bb1-8d90-9a7e6d5644a2 tempest-TestMinimumBasicScenario-1290309383 None] Lock "cinder-3782f048-b94c-4c91-a617-3eae2356a66c-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:23 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.483s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:23 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:24:23 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Deleted volume successfully. Jul 14 21:24:23 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4aabc389-3133-4e11-94ac-6413bdc589cd tempest-VolumeTypesAccessTest-1870110112 None] Lock "cinder-5885685c-bff5-42fe-a214-fe3d26594d03-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:23 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_b7tiyrucdevstack@QuobyteHD Jul 14 21:24:23 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:23 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_b7tiyrucdevstack@QuobyteHD" returned: 0 in 0.608s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:23 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 was qcow2, converting to raw {{(pid=88300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 21:24:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_b7tiyrucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:23 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_b7tiyrucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 Jul 14 21:24:23 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:26 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_b7tiyrucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91" returned: 0 in 2.359s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:26 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_b7tiyrucdevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:24:26 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Converted 112.00 MB image at 47.45 MB/s Jul 14 21:24:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:26 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 1G Jul 14 21:24:26 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:26 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 1G" returned: 0 in 0.373s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:26 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e63b45-0bcf-414b-996d-52a782c4afe3]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:26 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 Jul 14 21:24:26 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:26 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91" returned: 0 in 0.408s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:27 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 Jul 14 21:24:27 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:27 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91" returned: 1 in 0.475s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:24:27 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Downloaded image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}])) to volume 239f55c0-2140-4afc-81f6-e988f1267a91 successfully. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 21:24:27 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Temporary image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 for user a8ace832a1974bb69a080d723d3131ba is deleted. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 21:24:27 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Marking volume 239f55c0-2140-4afc-81f6-e988f1267a91 as bootable. {{(pid=88300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 21:24:27 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Copying metadata from image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 to 239f55c0-2140-4afc-81f6-e988f1267a91. {{(pid=88300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 21:24:27 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Creating volume glance metadata for volume 239f55c0-2140-4afc-81f6-e988f1267a91 backed by image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 21:24:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1bb82a-1c41-467d-bae4-7529f2b94401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-239f55c0-2140-4afc-81f6-e988f1267a91', 'volume_size': 1, 'image_id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31d13bd45fbb466f90c2faf198257b79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'created_at': datetime.datetime(2026, 7, 14, 19, 8, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 8, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54498bf-1e77-4b32-baf8-a885aed15a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:27 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Volume volume-239f55c0-2140-4afc-81f6-e988f1267a91 (239f55c0-2140-4afc-81f6-e988f1267a91): created successfully Jul 14 21:24:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54498bf-1e77-4b32-baf8-a885aed15a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Flow 'volume_create_manager' (f811c1ed-385f-4ecd-abdf-3d2bea0f9100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:27 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-29795c55-04dd-4e56-ae9a-b744b5992157 tempest-VolumesGetTest-1200256954 None] Created volume successfully. Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Flow 'volume_create_manager' (8296c4a2-c69b-4e48-b3db-15a16b11b898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45b7fac-6e44-494e-968a-88484aa26f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45b7fac-6e44-494e-968a-88484aa26f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1490594249',display_name='tempest-VolumesGetTest-Volume-1107452332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a610532-1101-4e30-b395-e80522311f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93c3c83ddf547268ef4de084c3ee49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:29Z,use_quota=True,user_id='a8ace832a1974bb69a080d723d3131ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb454aa-04d7-462c-a1bb-2ce8372816e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb454aa-04d7-462c-a1bb-2ce8372816e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c199f0-d32e-402c-be88-7caac2d670c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c199f0-d32e-402c-be88-7caac2d670c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a610532-1101-4e30-b395-e80522311f94', 'volume_name': 'volume-0a610532-1101-4e30-b395-e80522311f94', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8096c62-7e4b-48f8-b37b-b65e5f4dfb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8096c62-7e4b-48f8-b37b-b65e5f4dfb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d4ed1e-0874-45a2-bf9b-3dc0ab612fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:29 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Volume 0a610532-1101-4e30-b395-e80522311f94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a610532-1101-4e30-b395-e80522311f94', 'volume_size': 1} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1490594249',display_name='tempest-VolumesGetTest-Volume-1107452332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a610532-1101-4e30-b395-e80522311f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93c3c83ddf547268ef4de084c3ee49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:29Z,use_quota=True,user_id='a8ace832a1974bb69a080d723d3131ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Creating volume 0a610532-1101-4e30-b395-e80522311f94 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:24:29 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0a610532-1101-4e30-b395-e80522311f94 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:29 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0a610532-1101-4e30-b395-e80522311f94 1073741824 Jul 14 21:24:29 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:29 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0a610532-1101-4e30-b395-e80522311f94 1073741824" returned: 0 in 0.677s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0a610532-1101-4e30-b395-e80522311f94 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:30 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0a610532-1101-4e30-b395-e80522311f94 Jul 14 21:24:30 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:30 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0a610532-1101-4e30-b395-e80522311f94" returned: 0 in 0.483s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:24:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d4ed1e-0874-45a2-bf9b-3dc0ab612fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a610532-1101-4e30-b395-e80522311f94', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080dc581-7fab-40c3-9a82-5718923d79ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:30 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Volume volume-0a610532-1101-4e30-b395-e80522311f94 (0a610532-1101-4e30-b395-e80522311f94): created successfully Jul 14 21:24:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080dc581-7fab-40c3-9a82-5718923d79ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Flow 'volume_create_manager' (8296c4a2-c69b-4e48-b3db-15a16b11b898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:30 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-8e802ff6-f934-472c-b5f7-4b92211d56fa tempest-VolumesGetTest-1200256954 None] Created volume successfully. Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Flow 'volume_create_manager' (12551fcf-268f-4f52-b403-cd8fd3ba4286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f105ccd9-5946-4877-87b8-e9c620678278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f105ccd9-5946-4877-87b8-e9c620678278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1713324739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad7be6e0f6b54ed0b36bf5581ce7544a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:31Z,use_quota=True,user_id='0090c3ca9b7d454d94a9ea081274b97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b6f289-e94a-4972-b75f-e38dbf20b999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b6f289-e94a-4972-b75f-e38dbf20b999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576f55b7-27f5-4d0b-999f-3b38c6abf304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576f55b7-27f5-4d0b-999f-3b38c6abf304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b', 'volume_name': 'volume-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a199ab8a-76fb-4dcb-976e-3987109b064f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a199ab8a-76fb-4dcb-976e-3987109b064f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a24f6c-7235-46bf-a1c8-fce728b3daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:31 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Volume 040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b', 'volume_size': 1} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1713324739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad7be6e0f6b54ed0b36bf5581ce7544a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:31Z,use_quota=True,user_id='0090c3ca9b7d454d94a9ea081274b97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Creating volume 040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:24:31 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:31 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b 1073741824 Jul 14 21:24:31 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] Acquiring lock "cinder-0a610532-1101-4e30-b395-e80522311f94-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] Lock "cinder-0a610532-1101-4e30-b395-e80522311f94-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] Acquiring lock "cinder-quobyte-0a610532-1101-4e30-b395-e80522311f94" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-0a610532-1101-4e30-b395-e80522311f94" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[962c13b0-3707-4a3d-96af-77d0fcd15186]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0a610532-1101-4e30-b395-e80522311f94 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:31 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0a610532-1101-4e30-b395-e80522311f94 Jul 14 21:24:31 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:32 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b 1073741824" returned: 0 in 0.593s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:32 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b Jul 14 21:24:32 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:32 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0a610532-1101-4e30-b395-e80522311f94" returned: 0 in 0.465s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0a610532-1101-4e30-b395-e80522311f94 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:32 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0a610532-1101-4e30-b395-e80522311f94 Jul 14 21:24:32 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:32 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b" returned: 0 in 0.319s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a24f6c-7235-46bf-a1c8-fce728b3daf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b750e051-446e-42c8-a3af-68ed89593afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:32 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Volume volume-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b (040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b): created successfully Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b750e051-446e-42c8-a3af-68ed89593afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Flow 'volume_create_manager' (12551fcf-268f-4f52-b403-cd8fd3ba4286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:32 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-4b38d683-0965-445a-aa70-027bf82321fd tempest-VolumesTransfersV357Test-1423123242 None] Created volume successfully. Jul 14 21:24:32 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0a610532-1101-4e30-b395-e80522311f94" returned: 0 in 0.333s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-0a610532-1101-4e30-b395-e80522311f94" released by "delete_volume" :: held 0.870s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] Created reservations ['d02c736e-97ce-4068-aba9-75ef9f5339b7', 'ec3df017-0228-4e5f-8aff-baa56fa394e4', '98802caa-3c30-4c80-a03c-430bb46c0e0d', '53655225-4b45-40e9-b08a-0a165b08a3f5'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:32 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:24:32 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Acquiring lock "cinder-239f55c0-2140-4afc-81f6-e988f1267a91-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Lock "cinder-239f55c0-2140-4afc-81f6-e988f1267a91-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Acquiring lock "cinder-quobyte-239f55c0-2140-4afc-81f6-e988f1267a91" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-239f55c0-2140-4afc-81f6-e988f1267a91" acquired by "delete_volume" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:33 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d99900-1073-4a7f-a1c9-87f2fb8ee90c]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:33 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.406s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:33 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:24:33 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] Deleted volume successfully. Jul 14 21:24:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1a655de0-a101-409f-88a6-6c2394cd6f2f tempest-VolumesGetTest-1200256954 None] Lock "cinder-0a610532-1101-4e30-b395-e80522311f94-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:33 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 Jul 14 21:24:33 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:33 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91" returned: 0 in 0.585s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:33 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 Jul 14 21:24:33 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:34 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91" returned: 1 in 0.559s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:24:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:34 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91 Jul 14 21:24:34 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:34 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-8eba3b42-0040-45b8-90fa-f61aa9863c46 tempest-VolumesTransfersV357Test-1839423622 None] Transfer volume completed successfully. Jul 14 21:24:34 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-239f55c0-2140-4afc-81f6-e988f1267a91" returned: 0 in 0.321s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Lock "cinder-quobyte-239f55c0-2140-4afc-81f6-e988f1267a91" released by "delete_volume" :: held 1.572s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:34 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Created reservations ['e4a23689-56cb-4362-b5c2-a6cd8f512dbf', '1050d097-4fa4-475c-9ef4-191421b686e0', '32443b5d-9f8e-4710-977d-1910dbb974fd', '7c0c50fb-f37e-4a4e-8144-ccd34c3a242c'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:24:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:34 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:34 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:34 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:24:34 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:35 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.305s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:35 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:24:35 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Deleted volume successfully. Jul 14 21:24:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-caf7b412-9f5a-4eca-8f15-b17fcf442671 tempest-VolumesGetTest-1200256954 None] Lock "cinder-239f55c0-2140-4afc-81f6-e988f1267a91-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] Acquiring lock "cinder-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] Lock "cinder-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] Acquiring lock "cinder-quobyte-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] Lock "cinder-quobyte-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b" acquired by "delete_volume" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:35 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d13f47-5055-45c9-9173-7f9a6dfdfff5]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:35 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b Jul 14 21:24:35 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:36 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b" returned: 0 in 0.456s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:36 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b Jul 14 21:24:36 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:36 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b" returned: 0 in 0.281s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:36 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] Lock "cinder-quobyte-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b" released by "delete_volume" :: held 0.790s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:36 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] Created reservations ['eb3aade3-3744-4478-a9a3-76778e7325eb', '0071b7db-e643-4991-b68d-6d9b48ea8937', '09e00466-03d4-46ca-97f1-c1dc2e4a86ba', '504d0aa0-f573-44ee-ac3f-77c77bd098a2'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:24:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:24:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 28 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:24:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:24:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:36 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:24:36 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:36 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.373s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:36 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:24:37 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] Deleted volume successfully. Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d1b07b7e-16a0-4dfa-b4ad-2cdffeb812ce tempest-VolumesTransfersV357Test-211958269 None] Lock "cinder-040c1ac1-8f25-4ea5-b16a-9ebcabc86c4b-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Flow 'volume_create_manager' (0379112c-e2d6-45a3-89e2-ac77270fe377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07569fc9-3026-4d75-bd88-972b41359860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07569fc9-3026-4d75-bd88-972b41359860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1986899243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620e5f9e-90d1-4985-ace7-7570ed4e62a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad7be6e0f6b54ed0b36bf5581ce7544a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:38Z,use_quota=True,user_id='0090c3ca9b7d454d94a9ea081274b97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1242fd-41d4-4ac4-ba1d-8588e02ef308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1242fd-41d4-4ac4-ba1d-8588e02ef308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cae5935-a9a4-45f7-a7e1-de73865800f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cae5935-a9a4-45f7-a7e1-de73865800f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '620e5f9e-90d1-4985-ace7-7570ed4e62a7', 'volume_name': 'volume-620e5f9e-90d1-4985-ace7-7570ed4e62a7', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f8046d-2c34-41a6-a43e-3d33a21afda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f8046d-2c34-41a6-a43e-3d33a21afda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b667d1a8-4891-439f-a1d6-88ede773256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:37 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Volume 620e5f9e-90d1-4985-ace7-7570ed4e62a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-620e5f9e-90d1-4985-ace7-7570ed4e62a7', 'volume_size': 1} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1986899243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620e5f9e-90d1-4985-ace7-7570ed4e62a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad7be6e0f6b54ed0b36bf5581ce7544a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:38Z,use_quota=True,user_id='0090c3ca9b7d454d94a9ea081274b97b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Creating volume 620e5f9e-90d1-4985-ace7-7570ed4e62a7 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:24:37 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:24:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-620e5f9e-90d1-4985-ace7-7570ed4e62a7 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:37 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-620e5f9e-90d1-4985-ace7-7570ed4e62a7 1073741824 Jul 14 21:24:37 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:38 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-620e5f9e-90d1-4985-ace7-7570ed4e62a7 1073741824" returned: 0 in 0.546s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-620e5f9e-90d1-4985-ace7-7570ed4e62a7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:38 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-620e5f9e-90d1-4985-ace7-7570ed4e62a7 Jul 14 21:24:38 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:38 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-620e5f9e-90d1-4985-ace7-7570ed4e62a7" returned: 0 in 0.356s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:24:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b667d1a8-4891-439f-a1d6-88ede773256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620e5f9e-90d1-4985-ace7-7570ed4e62a7', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ec9990-97c7-4f8f-a2b8-67c753020b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:38 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Volume volume-620e5f9e-90d1-4985-ace7-7570ed4e62a7 (620e5f9e-90d1-4985-ace7-7570ed4e62a7): created successfully Jul 14 21:24:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ec9990-97c7-4f8f-a2b8-67c753020b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Flow 'volume_create_manager' (0379112c-e2d6-45a3-89e2-ac77270fe377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:38 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-557e91fd-2df1-41f6-b7a5-f699bbd1e6cd tempest-VolumesTransfersV357Test-1423123242 None] Created volume successfully. Jul 14 21:24:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] Acquiring lock "cinder-620e5f9e-90d1-4985-ace7-7570ed4e62a7-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] Lock "cinder-620e5f9e-90d1-4985-ace7-7570ed4e62a7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] Acquiring lock "cinder-quobyte-620e5f9e-90d1-4985-ace7-7570ed4e62a7" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:24:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] Lock "cinder-quobyte-620e5f9e-90d1-4985-ace7-7570ed4e62a7" acquired by "delete_volume" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:24:40 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[113b1569-84af-4e3e-82eb-6045661fb9b0]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-620e5f9e-90d1-4985-ace7-7570ed4e62a7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:40 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-620e5f9e-90d1-4985-ace7-7570ed4e62a7 Jul 14 21:24:40 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:40 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-620e5f9e-90d1-4985-ace7-7570ed4e62a7" returned: 0 in 0.591s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-620e5f9e-90d1-4985-ace7-7570ed4e62a7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:40 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-620e5f9e-90d1-4985-ace7-7570ed4e62a7 Jul 14 21:24:40 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:41 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-620e5f9e-90d1-4985-ace7-7570ed4e62a7" returned: 0 in 0.384s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] Lock "cinder-quobyte-620e5f9e-90d1-4985-ace7-7570ed4e62a7" released by "delete_volume" :: held 1.069s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:41 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] Created reservations ['edf12530-d1a3-4d10-ba43-b6c1f4cb3ecf', 'ceaaaab7-8bd4-456c-91b2-0d058e42b157', 'ccb6be4f-a393-41d3-a354-4ba5c5486457', '33be21c8-eadf-4e39-97d3-a761b0590afc'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:24:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:41 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:24:41 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:41 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.310s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:41 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:24:41 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] Deleted volume successfully. Jul 14 21:24:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c0decf28-a78d-4be0-835a-7b8437e3f372 tempest-VolumesTransfersV357Test-211958269 None] Lock "cinder-620e5f9e-90d1-4985-ace7-7570ed4e62a7-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:24:50 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:24:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Flow 'volume_create_manager' (425fd257-01b9-4dc6-82e5-28ba3fbb4014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15271fa-4051-4d7e-98ac-e57a997696f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15271fa-4051-4d7e-98ac-e57a997696f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1453588201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38562315-eb2a-41f7-ad93-0056ba4fb469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b79f515ec54bc7a8c7d478bccfee2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:51Z,use_quota=True,user_id='ce7d2f8d38d142c6a3f6e28c8b021d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca48f7b8-6d23-4250-870b-a3e6b6df6a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca48f7b8-6d23-4250-870b-a3e6b6df6a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83237f6b-7409-4cab-b820-9436a4f4f1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:50 devstack cinder-volume[88300]: DEBUG cinder.image.glance [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Creating Keystone auth plugin from conf {{(pid=88300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 21:24:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83237f6b-7409-4cab-b820-9436a4f4f1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '38562315-eb2a-41f7-ad93-0056ba4fb469', 'volume_name': 'volume-38562315-eb2a-41f7-ad93-0056ba4fb469', 'volume_size': 1, 'image_id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31d13bd45fbb466f90c2faf198257b79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'created_at': datetime.datetime(2026, 7, 14, 19, 8, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 8, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bdc1df-9090-4967-a234-247f8fa8a797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bdc1df-9090-4967-a234-247f8fa8a797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7ea9d3-e402-4a2b-aef3-5fadd30b33d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:51 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Volume 38562315-eb2a-41f7-ad93-0056ba4fb469: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-38562315-eb2a-41f7-ad93-0056ba4fb469', 'volume_size': 1, 'image_id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31d13bd45fbb466f90c2faf198257b79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'created_at': datetime.datetime(2026, 7, 14, 19, 8, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 8, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 14 21:24:51 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Trying to clone 38562315-eb2a-41f7-ad93-0056ba4fb469 from image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}]). {{(pid=88300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 21:24:52 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_t6nrl116devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 21:24:52 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Image download 20.69 MB at 20.69 MB/s Jul 14 21:24:52 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[715b4f54-0ebb-4c81-94f6-2b39320b018d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_t6nrl116devstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:52 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_t6nrl116devstack@QuobyteHD Jul 14 21:24:52 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:52 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_t6nrl116devstack@QuobyteHD" returned: 0 in 0.440s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:52 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Temporary image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 is fetched for user ce7d2f8d38d142c6a3f6e28c8b021d99. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 21:24:52 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[78559f72-4e6e-4197-b1d9-4c3e0dceefa9]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_t6nrl116devstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:52 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_t6nrl116devstack@QuobyteHD Jul 14 21:24:52 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:53 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_t6nrl116devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1453588201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38562315-eb2a-41f7-ad93-0056ba4fb469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b79f515ec54bc7a8c7d478bccfee2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:51Z,use_quota=True,user_id='ce7d2f8d38d142c6a3f6e28c8b021d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:24:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Creating volume 38562315-eb2a-41f7-ad93-0056ba4fb469 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:24:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:24:53 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:24:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:53 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 1073741824 Jul 14 21:24:53 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:53 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 1073741824" returned: 0 in 0.486s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:53 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 Jul 14 21:24:53 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:54 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469" returned: 0 in 0.335s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:24:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:54 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Attempting download of 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}])) to volume 38562315-eb2a-41f7-ad93-0056ba4fb469. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 21:24:54 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea62c05b-0eb7-4ce4-b795-314206061d61]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_ddu4h1jm {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:54 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_ddu4h1jm Jul 14 21:24:54 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:54 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_ddu4h1jm" returned: 0 in 0.370s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_ddu4h1jm {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:54 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_ddu4h1jm Jul 14 21:24:54 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:54 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_ddu4h1jm" returned: 1 in 0.413s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_ddu4h1jm' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:24:54 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0465da2d-e74f-47a3-a39b-2d2e7fbd9ab7]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_t6nrl116devstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:55 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_t6nrl116devstack@QuobyteHD Jul 14 21:24:55 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:55 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_t6nrl116devstack@QuobyteHD" returned: 0 in 0.433s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:55 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 was qcow2, converting to raw {{(pid=88300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 21:24:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_t6nrl116devstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:55 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_t6nrl116devstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 Jul 14 21:24:55 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:57 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_t6nrl116devstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469" returned: 0 in 2.198s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:57 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_t6nrl116devstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:24:57 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Converted 112.00 MB image at 50.93 MB/s Jul 14 21:24:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:57 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 1G Jul 14 21:24:57 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:58 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 1G" returned: 0 in 0.482s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:58 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a916a9bd-de45-4133-9675-a2cb92644a72]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:24:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:58 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 Jul 14 21:24:58 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:58 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469" returned: 0 in 0.568s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:58 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 Jul 14 21:24:58 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Flow 'volume_create_manager' (7362ba04-8f0c-4922-92cb-8d23fb2a6c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453f8bb2-204b-41d9-b46d-6138fefda0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453f8bb2-204b-41d9-b46d-6138fefda0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1949323615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f248738f-8963-4c3d-aad2-1bf015c0d7a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2cd41e64621348f7845a50702c8848a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:59Z,use_quota=True,user_id='7ca9ce464b614d0f83cc5ea85e7da443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d90f3be-1e05-4fd4-acdf-b875f8a6eecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d90f3be-1e05-4fd4-acdf-b875f8a6eecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a041112-a55f-436e-a39a-6bafb2b59e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a041112-a55f-436e-a39a-6bafb2b59e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f248738f-8963-4c3d-aad2-1bf015c0d7a8', 'volume_name': 'volume-f248738f-8963-4c3d-aad2-1bf015c0d7a8', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d0957c-2c86-4694-a53c-93c0df395fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d0957c-2c86-4694-a53c-93c0df395fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a4e9842-a1f3-47ad-a283-d3f0cb9fa250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:59 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Volume f248738f-8963-4c3d-aad2-1bf015c0d7a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f248738f-8963-4c3d-aad2-1bf015c0d7a8', 'volume_size': 1} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1949323615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f248738f-8963-4c3d-aad2-1bf015c0d7a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2cd41e64621348f7845a50702c8848a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:24:59Z,use_quota=True,user_id='7ca9ce464b614d0f83cc5ea85e7da443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Creating volume f248738f-8963-4c3d-aad2-1bf015c0d7a8 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:24:59 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f248738f-8963-4c3d-aad2-1bf015c0d7a8 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:24:59 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469" returned: 1 in 0.496s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Downloaded image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}])) to volume 38562315-eb2a-41f7-ad93-0056ba4fb469 successfully. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Temporary image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 for user ce7d2f8d38d142c6a3f6e28c8b021d99 is deleted. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Marking volume 38562315-eb2a-41f7-ad93-0056ba4fb469 as bootable. {{(pid=88300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 21:24:59 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f248738f-8963-4c3d-aad2-1bf015c0d7a8 1073741824 Jul 14 21:24:59 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Copying metadata from image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 to 38562315-eb2a-41f7-ad93-0056ba4fb469. {{(pid=88300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Creating volume glance metadata for volume 38562315-eb2a-41f7-ad93-0056ba4fb469 backed by image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7ea9d3-e402-4a2b-aef3-5fadd30b33d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38562315-eb2a-41f7-ad93-0056ba4fb469', 'volume_size': 1, 'image_id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31d13bd45fbb466f90c2faf198257b79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'created_at': datetime.datetime(2026, 7, 14, 19, 8, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 8, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12adfdcf-3792-4e45-86d1-b484d00bbd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:24:59 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Volume volume-38562315-eb2a-41f7-ad93-0056ba4fb469 (38562315-eb2a-41f7-ad93-0056ba4fb469): created successfully Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12adfdcf-3792-4e45-86d1-b484d00bbd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Flow 'volume_create_manager' (425fd257-01b9-4dc6-82e5-28ba3fbb4014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:24:59 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-647048bf-b9ec-44a7-a8f8-9517a68416af tempest-VolumesImageMetadata-2007284952 None] Created volume successfully. Jul 14 21:24:59 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f248738f-8963-4c3d-aad2-1bf015c0d7a8 1073741824" returned: 0 in 0.666s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:24:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f248738f-8963-4c3d-aad2-1bf015c0d7a8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:00 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f248738f-8963-4c3d-aad2-1bf015c0d7a8 Jul 14 21:25:00 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Acquiring lock "cinder-38562315-eb2a-41f7-ad93-0056ba4fb469-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Lock "cinder-38562315-eb2a-41f7-ad93-0056ba4fb469-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Acquiring lock "cinder-quobyte-38562315-eb2a-41f7-ad93-0056ba4fb469" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Lock "cinder-quobyte-38562315-eb2a-41f7-ad93-0056ba4fb469" acquired by "delete_volume" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:00 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6529009e-06bd-45f2-b1cf-1d1e193b7c35]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:00 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:00 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 Jul 14 21:25:00 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f248738f-8963-4c3d-aad2-1bf015c0d7a8" returned: 0 in 0.353s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:25:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a4e9842-a1f3-47ad-a283-d3f0cb9fa250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f248738f-8963-4c3d-aad2-1bf015c0d7a8', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5a0833-5ac6-4f44-87f4-f47ad23d4d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:00 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Volume volume-f248738f-8963-4c3d-aad2-1bf015c0d7a8 (f248738f-8963-4c3d-aad2-1bf015c0d7a8): created successfully Jul 14 21:25:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5a0833-5ac6-4f44-87f4-f47ad23d4d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Flow 'volume_create_manager' (7362ba04-8f0c-4922-92cb-8d23fb2a6c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:25:00 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-7efe370e-2d23-48d8-bd1f-2d107ad9ffee tempest-VolumesListTestJSON-2120126898 None] Created volume successfully. Jul 14 21:25:00 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469" returned: 0 in 0.416s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:00 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 Jul 14 21:25:00 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:00 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469" returned: 1 in 0.396s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:25:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:01 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469 Jul 14 21:25:01 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:01 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-38562315-eb2a-41f7-ad93-0056ba4fb469" returned: 0 in 0.384s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Lock "cinder-quobyte-38562315-eb2a-41f7-ad93-0056ba4fb469" released by "delete_volume" :: held 1.283s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:01 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Created reservations ['9792d3c0-8a52-4b44-8bc6-8f9dd43f282d', 'ccfb1666-d0fb-4816-b8b8-198c1729e1b3', '010ed83f-24e9-4eca-a0b4-4062231fdea1', '06ed4a60-9d4c-456e-abbb-7cdf1508f06d'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:25:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:25:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:25:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:01 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:25:01 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:01 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.424s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:01 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:25:02 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Deleted volume successfully. Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-bb61df2a-77a5-450c-9235-89a01a153e84 tempest-VolumesImageMetadata-2007284952 None] Lock "cinder-38562315-eb2a-41f7-ad93-0056ba4fb469-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Flow 'volume_create_manager' (93e05f7c-318a-4227-9a05-faa6b835e9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf2a8f24-3814-4e7c-b9db-15e40f2fac7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf2a8f24-3814-4e7c-b9db-15e40f2fac7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1920355998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f834a6-dc61-4074-8503-42ddea525932,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2cd41e64621348f7845a50702c8848a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:25:02Z,use_quota=True,user_id='7ca9ce464b614d0f83cc5ea85e7da443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec6d4b5-6076-4876-8e7c-742141275d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec6d4b5-6076-4876-8e7c-742141275d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6559c35f-9000-44e1-9d37-81e10be40b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6559c35f-9000-44e1-9d37-81e10be40b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4f834a6-dc61-4074-8503-42ddea525932', 'volume_name': 'volume-d4f834a6-dc61-4074-8503-42ddea525932', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4c1054-a2ef-4db0-b2f8-cccdedb69311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4c1054-a2ef-4db0-b2f8-cccdedb69311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6414f780-6fd0-4cb9-a784-4c3e84b1563a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:02 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Volume d4f834a6-dc61-4074-8503-42ddea525932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4f834a6-dc61-4074-8503-42ddea525932', 'volume_size': 1} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1920355998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f834a6-dc61-4074-8503-42ddea525932,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2cd41e64621348f7845a50702c8848a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:25:02Z,use_quota=True,user_id='7ca9ce464b614d0f83cc5ea85e7da443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Creating volume d4f834a6-dc61-4074-8503-42ddea525932 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:25:02 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d4f834a6-dc61-4074-8503-42ddea525932 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:02 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d4f834a6-dc61-4074-8503-42ddea525932 1073741824 Jul 14 21:25:02 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:02 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d4f834a6-dc61-4074-8503-42ddea525932 1073741824" returned: 0 in 0.538s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d4f834a6-dc61-4074-8503-42ddea525932 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:02 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d4f834a6-dc61-4074-8503-42ddea525932 Jul 14 21:25:02 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:03 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d4f834a6-dc61-4074-8503-42ddea525932" returned: 0 in 0.408s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:25:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6414f780-6fd0-4cb9-a784-4c3e84b1563a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f834a6-dc61-4074-8503-42ddea525932', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669dcb15-78d8-44be-8f3f-4af122e79be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:03 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Volume volume-d4f834a6-dc61-4074-8503-42ddea525932 (d4f834a6-dc61-4074-8503-42ddea525932): created successfully Jul 14 21:25:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669dcb15-78d8-44be-8f3f-4af122e79be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Flow 'volume_create_manager' (93e05f7c-318a-4227-9a05-faa6b835e9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:25:03 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-192d9c6d-546d-4dcd-a0c3-fb81a41780cb tempest-VolumesListTestJSON-2120126898 None] Created volume successfully. Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Flow 'volume_create_manager' (b29f0045-6741-46ae-b8fc-f66c11dcef3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f486132-6cae-4dd4-aa54-7bad95d0d392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f486132-6cae-4dd4-aa54-7bad95d0d392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1065888716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf6d565-b6df-41b0-9c7c-d57fbc8e695e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2cd41e64621348f7845a50702c8848a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:25:05Z,use_quota=True,user_id='7ca9ce464b614d0f83cc5ea85e7da443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47fd9c3-71ae-4252-b90c-e279fedfbc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47fd9c3-71ae-4252-b90c-e279fedfbc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d4a94c-0eaf-4246-adba-1507374eebe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d4a94c-0eaf-4246-adba-1507374eebe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbf6d565-b6df-41b0-9c7c-d57fbc8e695e', 'volume_name': 'volume-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85583757-2327-4361-993b-a3c941be4148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85583757-2327-4361-993b-a3c941be4148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d44721-55b9-4b06-86a4-4185bdc140c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:04 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Volume cbf6d565-b6df-41b0-9c7c-d57fbc8e695e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e', 'volume_size': 1} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1065888716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf6d565-b6df-41b0-9c7c-d57fbc8e695e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2cd41e64621348f7845a50702c8848a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:25:05Z,use_quota=True,user_id='7ca9ce464b614d0f83cc5ea85e7da443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Creating volume cbf6d565-b6df-41b0-9c7c-d57fbc8e695e {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:25:04 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:25:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:04 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e 1073741824 Jul 14 21:25:04 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:05 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e 1073741824" returned: 0 in 0.639s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:05 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e Jul 14 21:25:05 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:05 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e" returned: 0 in 0.315s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:25:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d44721-55b9-4b06-86a4-4185bdc140c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417867a5-93ba-4348-bd44-574c9088a6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:05 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Volume volume-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e (cbf6d565-b6df-41b0-9c7c-d57fbc8e695e): created successfully Jul 14 21:25:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417867a5-93ba-4348-bd44-574c9088a6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Flow 'volume_create_manager' (b29f0045-6741-46ae-b8fc-f66c11dcef3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:25:05 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-342ed685-58b8-4957-9aa1-cb9e075810fe tempest-VolumesListTestJSON-2120126898 None] Created volume successfully. Jul 14 21:25:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] Acquiring lock "cinder-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] Lock "cinder-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:09 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:UPDATE=142,cinder:INSERT=39,cinder:DELETE=18,cinder:SELECT=108 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:25:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] Acquiring lock "cinder-quobyte-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] Lock "cinder-quobyte-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:09 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1ddcb1-a6b0-4dd0-910b-0f281d316112]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:09 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e Jul 14 21:25:09 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:10 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e" returned: 0 in 0.492s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:10 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e Jul 14 21:25:10 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:10 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e" returned: 0 in 0.492s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:10 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] Lock "cinder-quobyte-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e" released by "delete_volume" :: held 1.055s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:10 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] Created reservations ['9ce9c612-90c4-4522-bd3d-b79f471a7399', '7f00c69f-36de-479d-a5c0-f37888fa31d7', '592aa190-7167-424a-8873-a1fa160ae4a5', 'e4daf0e0-d016-4519-b615-b5e042a9f88a'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:25:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:25:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:25:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:10 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:25:10 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:11 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.317s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:11 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:25:11 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] Deleted volume successfully. Jul 14 21:25:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0c7ef121-8258-4a81-9195-5ca552bcc6c2 tempest-VolumesListTestJSON-2120126898 None] Lock "cinder-cbf6d565-b6df-41b0-9c7c-d57fbc8e695e-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] Acquiring lock "cinder-d4f834a6-dc61-4074-8503-42ddea525932-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] Lock "cinder-d4f834a6-dc61-4074-8503-42ddea525932-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:11 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:UPDATE=138,cinder:SELECT=106,cinder:INSERT=49,cinder:DELETE=7 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:25:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] Acquiring lock "cinder-quobyte-d4f834a6-dc61-4074-8503-42ddea525932" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] Lock "cinder-quobyte-d4f834a6-dc61-4074-8503-42ddea525932" acquired by "delete_volume" :: waited 0.035s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:11 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fc01ca-50be-49d8-8256-6b6fed3fcba1]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d4f834a6-dc61-4074-8503-42ddea525932 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:12 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d4f834a6-dc61-4074-8503-42ddea525932 Jul 14 21:25:12 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:12 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d4f834a6-dc61-4074-8503-42ddea525932" returned: 0 in 0.466s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d4f834a6-dc61-4074-8503-42ddea525932 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:12 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d4f834a6-dc61-4074-8503-42ddea525932 Jul 14 21:25:12 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:12 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d4f834a6-dc61-4074-8503-42ddea525932" returned: 0 in 0.279s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] Lock "cinder-quobyte-d4f834a6-dc61-4074-8503-42ddea525932" released by "delete_volume" :: held 0.801s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:12 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] Created reservations ['c3fce55d-0b5b-40a4-94c9-1863fd945cee', '214dc39e-7597-4990-91f7-7b28a42d26fb', '4a775229-a4be-4997-887c-b09cc5200527', '32ff03b5-d8ae-4ee6-a8b8-369eb36651ac'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:25:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:25:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:25:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:12 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:25:12 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:13 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] Acquiring lock "cinder-f248738f-8963-4c3d-aad2-1bf015c0d7a8-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.332s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:13 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:25:13 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] Deleted volume successfully. Jul 14 21:25:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] Lock "cinder-f248738f-8963-4c3d-aad2-1bf015c0d7a8-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-72b3900f-7e3e-481e-8d60-23b8adda4a24 tempest-VolumesListTestJSON-2120126898 None] Lock "cinder-d4f834a6-dc61-4074-8503-42ddea525932-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] Acquiring lock "cinder-quobyte-f248738f-8963-4c3d-aad2-1bf015c0d7a8" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] Lock "cinder-quobyte-f248738f-8963-4c3d-aad2-1bf015c0d7a8" acquired by "delete_volume" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:13 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5f31c5-c7b3-41cf-a355-ddd210575c05]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f248738f-8963-4c3d-aad2-1bf015c0d7a8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:13 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f248738f-8963-4c3d-aad2-1bf015c0d7a8 Jul 14 21:25:13 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:13 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f248738f-8963-4c3d-aad2-1bf015c0d7a8" returned: 0 in 0.524s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f248738f-8963-4c3d-aad2-1bf015c0d7a8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:13 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f248738f-8963-4c3d-aad2-1bf015c0d7a8 Jul 14 21:25:13 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:14 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f248738f-8963-4c3d-aad2-1bf015c0d7a8" returned: 0 in 0.335s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] Lock "cinder-quobyte-f248738f-8963-4c3d-aad2-1bf015c0d7a8" released by "delete_volume" :: held 0.917s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:14 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] Created reservations ['514a7051-e115-419d-b278-c7a4301eb583', 'a7fb95f2-e33c-4111-b5ec-1cb41db1b603', '63c7a269-c443-4372-a54a-c777769ff8c1', '25c23dab-6240-43f6-9a92-c973461e03fb'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:25:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:25:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:25:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:14 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:25:14 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:14 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.394s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:14 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:25:14 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] Deleted volume successfully. Jul 14 21:25:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-301eb662-8b49-4c66-b03c-0a29468dc587 tempest-VolumesListTestJSON-2120126898 None] Lock "cinder-f248738f-8963-4c3d-aad2-1bf015c0d7a8-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Flow 'volume_create_manager' (731261db-b991-4cda-ae03-630fff42862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75dd006c-bf36-48e0-9df3-4429cf57778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75dd006c-bf36-48e0-9df3-4429cf57778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-264206083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93cb8dc4-9acf-4594-890c-b3c19755dd1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e629ddf61bad43ceb523a1203cbe998a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:25:16Z,use_quota=True,user_id='764f5012ce114e559b82fe2cb44ddd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ea4f08-4bad-4307-a363-31aa41d761f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ea4f08-4bad-4307-a363-31aa41d761f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd667156-b7f5-491a-bc04-7f071898e4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd667156-b7f5-491a-bc04-7f071898e4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93cb8dc4-9acf-4594-890c-b3c19755dd1a', 'volume_name': 'volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e788eb64-345b-4207-816a-de5a923a09c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e788eb64-345b-4207-816a-de5a923a09c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b3d78d-7fd5-4caf-bb53-76baf79901ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:15 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Volume 93cb8dc4-9acf-4594-890c-b3c19755dd1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a', 'volume_size': 1} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-264206083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93cb8dc4-9acf-4594-890c-b3c19755dd1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e629ddf61bad43ceb523a1203cbe998a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:25:16Z,use_quota=True,user_id='764f5012ce114e559b82fe2cb44ddd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Creating volume 93cb8dc4-9acf-4594-890c-b3c19755dd1a {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:25:15 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:25:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:15 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a 1073741824 Jul 14 21:25:15 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:16 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:25:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Flow 'volume_create_manager' (fcf7d8c9-85dd-4efe-8d12-d07ff75967bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:25:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fb4d26-9c3e-4bcd-af67-3c648a4ac3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fb4d26-9c3e-4bcd-af67-3c648a4ac3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-923698988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36edcdd3-0993-4081-b0df-cb0c154a0f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0db96dcb9164ad6b1ea06aa93e39d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:25:16Z,use_quota=True,user_id='433e808026b14b36897d9afc76c43a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab261d7-6126-4f67-a7c9-bc93d61cf89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab261d7-6126-4f67-a7c9-bc93d61cf89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54928cb1-26d6-4bdd-b076-6c9959ae4b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:16 devstack cinder-volume[88300]: DEBUG cinder.image.glance [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Creating Keystone auth plugin from conf {{(pid=88300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 21:25:16 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a 1073741824" returned: 0 in 0.802s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:16 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a Jul 14 21:25:16 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54928cb1-26d6-4bdd-b076-6c9959ae4b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '36edcdd3-0993-4081-b0df-cb0c154a0f9a', 'volume_name': 'volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a', 'volume_size': 1, 'image_id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31d13bd45fbb466f90c2faf198257b79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'created_at': datetime.datetime(2026, 7, 14, 19, 8, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 8, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d8d1929-26f8-4bea-b88f-9cbe9f4310ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d8d1929-26f8-4bea-b88f-9cbe9f4310ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:17 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85d498a-6aac-43fb-bd55-aaab0dc1c21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:17 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Volume 36edcdd3-0993-4081-b0df-cb0c154a0f9a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a', 'volume_size': 1, 'image_id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31d13bd45fbb466f90c2faf198257b79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'created_at': datetime.datetime(2026, 7, 14, 19, 8, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 8, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 14 21:25:17 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Trying to clone 36edcdd3-0993-4081-b0df-cb0c154a0f9a from image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}]). {{(pid=88300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 21:25:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a" returned: 0 in 0.375s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:25:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b3d78d-7fd5-4caf-bb53-76baf79901ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39091be-b3d4-4caf-8486-3507105902d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:17 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Volume volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a (93cb8dc4-9acf-4594-890c-b3c19755dd1a): created successfully Jul 14 21:25:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39091be-b3d4-4caf-8486-3507105902d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Flow 'volume_create_manager' (731261db-b991-4cda-ae03-630fff42862e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:25:17 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-ba6042ac-7706-4597-a81f-5a763c5c6500 tempest-TestStampPattern-1434720668 None] Created volume successfully. Jul 14 21:25:17 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_9xc3kn0bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 21:25:17 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Image download 20.69 MB at 20.69 MB/s Jul 14 21:25:17 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba73c301-174e-401f-8b0c-e8176a91566a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_9xc3kn0bdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:17 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_9xc3kn0bdevstack@QuobyteHD Jul 14 21:25:17 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:18 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_9xc3kn0bdevstack@QuobyteHD" returned: 0 in 0.622s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:18 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Temporary image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 is fetched for user 433e808026b14b36897d9afc76c43a5d. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 21:25:18 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf51d6e-d8b6-4fcf-9260-c643e13165e6]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_9xc3kn0bdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:18 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_9xc3kn0bdevstack@QuobyteHD Jul 14 21:25:18 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:19 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_9xc3kn0bdevstack@QuobyteHD" returned: 0 in 0.540s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-923698988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36edcdd3-0993-4081-b0df-cb0c154a0f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0db96dcb9164ad6b1ea06aa93e39d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:25:16Z,use_quota=True,user_id='433e808026b14b36897d9afc76c43a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:25:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Creating volume 36edcdd3-0993-4081-b0df-cb0c154a0f9a {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:25:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:25:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:25:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:25:19 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:25:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:19 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a 1073741824 Jul 14 21:25:19 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:19 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Flow 'volume_create_manager' (16d38580-5e41-4893-93d9-0194016972d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b081f8-9211-41c2-8a7b-56f1843e180f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:20 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a 1073741824" returned: 0 in 0.850s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b081f8-9211-41c2-8a7b-56f1843e180f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1450297224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d359738a-62fa-4263-8939-ced9d37bae0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb78b758e20482cb30c201019bb60e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:25:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:25:20Z,use_quota=True,user_id='b32f3f37459b456084969ae7df3a3e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70bdb98b-ab63-49eb-9231-a94696d439c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70bdb98b-ab63-49eb-9231-a94696d439c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450dc698-9131-4b36-8571-2fb1424db7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450dc698-9131-4b36-8571-2fb1424db7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd359738a-62fa-4263-8939-ced9d37bae0a', 'volume_name': 'volume-d359738a-62fa-4263-8939-ced9d37bae0a', 'volume_size': 2}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcbd576a-fb62-4be3-a14e-aaeb4b6e5849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcbd576a-fb62-4be3-a14e-aaeb4b6e5849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad65032-9aed-4904-9379-45bbc65255e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:20 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Volume d359738a-62fa-4263-8939-ced9d37bae0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d359738a-62fa-4263-8939-ced9d37bae0a', 'volume_size': 2} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:20 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a Jul 14 21:25:20 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:20 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a" returned: 0 in 0.421s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.483s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1450297224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d359738a-62fa-4263-8939-ced9d37bae0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeb78b758e20482cb30c201019bb60e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:25:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:25:20Z,use_quota=True,user_id='b32f3f37459b456084969ae7df3a3e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Creating volume d359738a-62fa-4263-8939-ced9d37bae0a {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:25:20 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a 2147483648 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:20 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a 2147483648 Jul 14 21:25:20 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Attempting download of 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}])) to volume 36edcdd3-0993-4081-b0df-cb0c154a0f9a. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15ccf6d-67bc-496a-9215-4e4bb5a07eac]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_u856dm6t {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:21 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_u856dm6t Jul 14 21:25:21 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:21 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_u856dm6t" returned: 0 in 0.541s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_u856dm6t {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:21 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a 2147483648" returned: 0 in 0.783s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:21 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_u856dm6t Jul 14 21:25:21 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:21 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a Jul 14 21:25:21 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:21 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_u856dm6t" returned: 1 in 0.648s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_u856dm6t' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:25:22 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c94a800-fe55-4232-bc8d-29a83c1419c9]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_9xc3kn0bdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:22 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a" returned: 0 in 0.656s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:25:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad65032-9aed-4904-9379-45bbc65255e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d359738a-62fa-4263-8939-ced9d37bae0a', 'volume_size': 2}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fc6efc-faee-4d5f-8a42-9a6e936eb41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:22 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Volume volume-d359738a-62fa-4263-8939-ced9d37bae0a (d359738a-62fa-4263-8939-ced9d37bae0a): created successfully Jul 14 21:25:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fc6efc-faee-4d5f-8a42-9a6e936eb41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Flow 'volume_create_manager' (16d38580-5e41-4893-93d9-0194016972d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:25:22 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-4dd4b95f-1b0d-4237-9fa0-6fb6c193a8d0 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Created volume successfully. Jul 14 21:25:22 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_9xc3kn0bdevstack@QuobyteHD Jul 14 21:25:22 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:22 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_9xc3kn0bdevstack@QuobyteHD" returned: 0 in 0.737s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:22 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 was qcow2, converting to raw {{(pid=88300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 21:25:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_9xc3kn0bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:22 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_9xc3kn0bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a Jul 14 21:25:22 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Creating offline snapshot 9d98c654-420c-415c-94de-cad0d3f1067b of volume d359738a-62fa-4263-8939-ced9d37bae0a {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:25:23 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d74ddb-2466-4ef7-b3b6-e1e16fa5324a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:24 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a Jul 14 21:25:24 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:24 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a" returned: 0 in 1.147s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b 2G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:24 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b 2G Jul 14 21:25:24 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:26 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b 2G" returned: 0 in 1.084s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d359738a-62fa-4263-8939-ced9d37bae0a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:26 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d359738a-62fa-4263-8939-ced9d37bae0a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b Jul 14 21:25:26 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:26 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_9xc3kn0bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a" returned: 0 in 3.534s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:26 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_9xc3kn0bdevstack@QuobyteHD, size 112.00 MB, duration 3.54 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:25:26 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Converted 112.00 MB image at 31.68 MB/s Jul 14 21:25:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:26 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a 1G Jul 14 21:25:26 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:26 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d359738a-62fa-4263-8939-ced9d37bae0a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b" returned: 0 in 0.728s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:26 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b is being set with open permissions: ugo+rw Jul 14 21:25:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:26 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b Jul 14 21:25:26 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:26 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a 1G" returned: 0 in 0.685s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:27 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc13241a-1d13-40a2-a6c7-62514e657b60]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:27 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b" returned: 0 in 0.425s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:27 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a Jul 14 21:25:27 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:27 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.info Jul 14 21:25:27 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:27 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.info" returned: 0 in 0.466s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:27 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.info is being set with open permissions: ugo+rw Jul 14 21:25:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:27 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.info Jul 14 21:25:27 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:27 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a" returned: 0 in 0.699s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:28 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a Jul 14 21:25:28 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:28 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.info" returned: 0 in 0.621s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.638s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:28 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-4f3f48cc-9b94-4715-aa30-2f5881cc74bb tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Create snapshot completed successfully Jul 14 21:25:28 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a" returned: 1 in 0.669s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:25:28 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Downloaded image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}])) to volume 36edcdd3-0993-4081-b0df-cb0c154a0f9a successfully. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 21:25:28 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Temporary image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 for user 433e808026b14b36897d9afc76c43a5d is deleted. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 21:25:28 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Marking volume 36edcdd3-0993-4081-b0df-cb0c154a0f9a as bootable. {{(pid=88300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 21:25:28 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Copying metadata from image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 to 36edcdd3-0993-4081-b0df-cb0c154a0f9a. {{(pid=88300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 21:25:28 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Creating volume glance metadata for volume 36edcdd3-0993-4081-b0df-cb0c154a0f9a backed by image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 21:25:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85d498a-6aac-43fb-bd55-aaab0dc1c21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a', 'volume_size': 1, 'image_id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31d13bd45fbb466f90c2faf198257b79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'created_at': datetime.datetime(2026, 7, 14, 19, 8, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 8, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565f8c28-45e0-4ec2-88c9-962dce544453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:28 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Volume volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a (36edcdd3-0993-4081-b0df-cb0c154a0f9a): created successfully Jul 14 21:25:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565f8c28-45e0-4ec2-88c9-962dce544453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Flow 'volume_create_manager' (fcf7d8c9-85dd-4efe-8d12-d07ff75967bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:25:28 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-535cf3a8-c523-4e03-bad5-0c6a4e067a35 tempest-VolumesExtendTest-1276270698 None] Created volume successfully. Jul 14 21:25:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Acquiring lock "cinder-9d98c654-420c-415c-94de-cad0d3f1067b-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "cinder-9d98c654-420c-415c-94de-cad0d3f1067b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Acquiring lock "cinder-quobyte-d359738a-62fa-4263-8939-ced9d37bae0a" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "cinder-quobyte-d359738a-62fa-4263-8939-ced9d37bae0a" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Acquiring lock "cinder-quobyte-9d98c654-420c-415c-94de-cad0d3f1067b" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "cinder-quobyte-9d98c654-420c-415c-94de-cad0d3f1067b" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Deleting offline snapshot 9d98c654-420c-415c-94de-cad0d3f1067b of volume d359738a-62fa-4263-8939-ced9d37bae0a {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:25:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] snapshot_file for this snap is: volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:25:29 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8e93e3-2d46-4a33-8435-b2f30eb56812]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:29 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b Jul 14 21:25:29 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:30 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b" returned: 0 in 0.628s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d359738a-62fa-4263-8939-ced9d37bae0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:25:30 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[382a1123-d15d-4595-ba20-29c570a3eb79]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8d2d2b82-3242-4e9f-b81b-cbd8194b6964 tempest-VolumesExtendTest-1276270698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8d2d2b82-3242-4e9f-b81b-cbd8194b6964 tempest-VolumesExtendTest-1276270698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:30 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdfb9c3-8eb2-4b9c-9139-69ef658297db]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8d2d2b82-3242-4e9f-b81b-cbd8194b6964 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:30 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a Jul 14 21:25:30 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:30 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a Jul 14 21:25:30 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:31 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:31 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a" returned: 0 in 0.890s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8d2d2b82-3242-4e9f-b81b-cbd8194b6964 tempest-VolumesExtendTest-1276270698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a" returned: 0 in 0.643s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8d2d2b82-3242-4e9f-b81b-cbd8194b6964 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:31 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b Jul 14 21:25:31 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:31 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a Jul 14 21:25:31 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:31 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8d2d2b82-3242-4e9f-b81b-cbd8194b6964 tempest-VolumesExtendTest-1276270698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a" returned: 1 in 0.492s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8d2d2b82-3242-4e9f-b81b-cbd8194b6964 tempest-VolumesExtendTest-1276270698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:25:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8d2d2b82-3242-4e9f-b81b-cbd8194b6964 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a 2G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8d2d2b82-3242-4e9f-b81b-cbd8194b6964 tempest-VolumesExtendTest-1276270698 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a 2G" returned: 0 in 0.092s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8d2d2b82-3242-4e9f-b81b-cbd8194b6964 tempest-VolumesExtendTest-1276270698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.352s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:31 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-8d2d2b82-3242-4e9f-b81b-cbd8194b6964 tempest-VolumesExtendTest-1276270698 None] Extend volume completed successfully. Jul 14 21:25:31 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b" returned: 0 in 0.710s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:31 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b Jul 14 21:25:31 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:32 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a.9d98c654-420c-415c-94de-cad0d3f1067b" returned: 0 in 0.301s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "cinder-quobyte-9d98c654-420c-415c-94de-cad0d3f1067b" released by "_delete_snapshot" :: held 2.766s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "cinder-quobyte-d359738a-62fa-4263-8939-ced9d37bae0a" released by "delete_snapshot" :: held 2.810s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:32 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Created reservations ['3331eb96-123d-49ce-afa6-8f4b0716285a', '0d1af882-3cb3-4cfe-8121-5d098d693c45', '840944c1-02a1-4fbf-a37b-58dcda7fd1cc', '6b3d181b-873a-40ed-bb81-c4d1f5becacf'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:25:32 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Delete snapshot completed successfully. Jul 14 21:25:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-68cd0952-8771-4963-a162-7bd24decfa4f tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "cinder-9d98c654-420c-415c-94de-cad0d3f1067b-delete_snapshot" released by "delete_snapshot" :: held 3.099s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Acquiring lock "cinder-d359738a-62fa-4263-8939-ced9d37bae0a-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "cinder-d359738a-62fa-4263-8939-ced9d37bae0a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Acquiring lock "cinder-36edcdd3-0993-4081-b0df-cb0c154a0f9a-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Acquiring lock "cinder-quobyte-d359738a-62fa-4263-8939-ced9d37bae0a" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Lock "cinder-36edcdd3-0993-4081-b0df-cb0c154a0f9a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "cinder-quobyte-d359738a-62fa-4263-8939-ced9d37bae0a" acquired by "delete_volume" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:33 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a8bb9f-35df-49f2-8330-b2fe43793e1a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Acquiring lock "cinder-quobyte-36edcdd3-0993-4081-b0df-cb0c154a0f9a" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Lock "cinder-quobyte-36edcdd3-0993-4081-b0df-cb0c154a0f9a" acquired by "delete_volume" :: waited 0.032s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:33 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bfc5f3-aba4-4e58-91a6-da8ab903a8af]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:33 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a Jul 14 21:25:33 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:33 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a Jul 14 21:25:33 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:33 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a" returned: 0 in 0.791s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:33 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a Jul 14 21:25:33 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:34 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a" returned: 0 in 0.880s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:34 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a Jul 14 21:25:34 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:34 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d359738a-62fa-4263-8939-ced9d37bae0a" returned: 0 in 0.594s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "cinder-quobyte-d359738a-62fa-4263-8939-ced9d37bae0a" released by "delete_volume" :: held 1.503s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:34 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Created reservations ['a8ce3879-80cd-40ac-bca6-2f8751f1dddc', '66e202c3-0117-46ed-bcd5-00b04df3fb4f', 'f920a646-c1ff-4dee-b734-180e7c38915f', 'e35d7a30-8b1c-47b8-a4bb-38aa79485263'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:25:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:34 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:25:34 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:25:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:34 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:25:34 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:34 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a" returned: 1 in 0.810s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:25:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:34 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a Jul 14 21:25:34 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:35 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.295s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:35 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:25:35 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Deleted volume successfully. Jul 14 21:25:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-11a575ec-178d-485f-a568-cc16c4f03115 tempest-VolumesSnapshotNegativeTestJSON-266782108 None] Lock "cinder-d359738a-62fa-4263-8939-ced9d37bae0a-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:35 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-36edcdd3-0993-4081-b0df-cb0c154a0f9a" returned: 0 in 0.524s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Lock "cinder-quobyte-36edcdd3-0993-4081-b0df-cb0c154a0f9a" released by "delete_volume" :: held 2.322s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:35 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Created reservations ['9617e945-6f1d-4ece-83f3-b782ac6075d4', '50076f4c-7085-4500-a574-25826d1d29a4', '5775d623-4f62-4d22-b935-c94679ec35e7', 'ecc70152-3d6d-4c71-898a-ba67a252630f'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:25:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:25:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:25:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:35 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:25:35 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:36 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.325s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:36 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:25:36 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Deleted volume successfully. Jul 14 21:25:36 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f88c7f4c-0be9-459b-9b37-058fe771acb0 tempest-VolumesExtendTest-1276270698 None] Lock "cinder-36edcdd3-0993-4081-b0df-cb0c154a0f9a-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:25:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:25:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:25:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:36 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:25:36 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:37 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.637s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 28 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Flow 'volume_create_manager' (606385bf-e41a-4910-a5fc-fe550d2d1e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3301f3e-d9c0-41da-ae9b-9c7bbf383676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3301f3e-d9c0-41da-ae9b-9c7bbf383676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1339008878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ae0357-6386-47b2-97e5-739812a93b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0db96dcb9164ad6b1ea06aa93e39d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:25:38Z,use_quota=True,user_id='433e808026b14b36897d9afc76c43a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659f0d17-1037-47d9-85cf-d86bb85f8207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659f0d17-1037-47d9-85cf-d86bb85f8207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125cb341-0d5e-40f0-8893-7eb9aeb80cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125cb341-0d5e-40f0-8893-7eb9aeb80cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ae0357-6386-47b2-97e5-739812a93b5b', 'volume_name': 'volume-48ae0357-6386-47b2-97e5-739812a93b5b', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6995b1-4bf3-42da-8b76-149928ed433e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6995b1-4bf3-42da-8b76-149928ed433e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e68821-44a1-4dd9-b8b1-abb2c29bbd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:37 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Volume 48ae0357-6386-47b2-97e5-739812a93b5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ae0357-6386-47b2-97e5-739812a93b5b', 'volume_size': 1} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1339008878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ae0357-6386-47b2-97e5-739812a93b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0db96dcb9164ad6b1ea06aa93e39d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:25:38Z,use_quota=True,user_id='433e808026b14b36897d9afc76c43a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Creating volume 48ae0357-6386-47b2-97e5-739812a93b5b {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:25:37 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:25:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:37 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b 1073741824 Jul 14 21:25:37 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:38 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b 1073741824" returned: 0 in 0.714s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:38 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b Jul 14 21:25:38 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:38 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b" returned: 0 in 0.301s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:25:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e68821-44a1-4dd9-b8b1-abb2c29bbd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ae0357-6386-47b2-97e5-739812a93b5b', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c377ee-57ba-41d4-978a-bcb97299de7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:38 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Volume volume-48ae0357-6386-47b2-97e5-739812a93b5b (48ae0357-6386-47b2-97e5-739812a93b5b): created successfully Jul 14 21:25:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c377ee-57ba-41d4-978a-bcb97299de7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Flow 'volume_create_manager' (606385bf-e41a-4910-a5fc-fe550d2d1e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:25:38 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f63e7afc-255a-4d88-9ed4-4d767375731e tempest-VolumesExtendTest-1276270698 None] Created volume successfully. Jul 14 21:25:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] Creating offline snapshot 28c8d247-75ab-4697-ad4d-c2bbc1791a4c of volume 48ae0357-6386-47b2-97e5-739812a93b5b {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:25:39 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5d8f2a-0cb4-485d-9e24-2c00a6be6500]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:40 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b Jul 14 21:25:40 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:40 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b" returned: 0 in 0.435s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:40 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c 1G Jul 14 21:25:40 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:40 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c 1G" returned: 0 in 0.498s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ae0357-6386-47b2-97e5-739812a93b5b -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:40 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ae0357-6386-47b2-97e5-739812a93b5b -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c Jul 14 21:25:40 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:41 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ae0357-6386-47b2-97e5-739812a93b5b -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c" returned: 0 in 0.310s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:41 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c is being set with open permissions: ugo+rw Jul 14 21:25:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:41 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c Jul 14 21:25:41 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:41 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c" returned: 0 in 0.263s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:41 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.info Jul 14 21:25:41 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:41 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.info" returned: 0 in 0.257s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:41 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.info is being set with open permissions: ugo+rw Jul 14 21:25:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:41 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.info Jul 14 21:25:41 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:42 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.info" returned: 0 in 0.248s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.115s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:42 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-63c59bbc-d3d0-4321-9c94-23d55db4d2a2 tempest-VolumesExtendTest-1276270698 None] Create snapshot completed successfully Jul 14 21:25:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8bcdf69e-7e0d-4415-a6bc-074eedd80438 tempest-VolumesExtendTest-1276270698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8bcdf69e-7e0d-4415-a6bc-074eedd80438 tempest-VolumesExtendTest-1276270698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:43 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b754f6-23c3-4d30-9efe-0f8b07db9f8d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8bcdf69e-7e0d-4415-a6bc-074eedd80438 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:43 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b Jul 14 21:25:43 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:43 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8bcdf69e-7e0d-4415-a6bc-074eedd80438 tempest-VolumesExtendTest-1276270698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b" returned: 0 in 0.389s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8bcdf69e-7e0d-4415-a6bc-074eedd80438 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c 2G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8bcdf69e-7e0d-4415-a6bc-074eedd80438 tempest-VolumesExtendTest-1276270698 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c 2G" returned: 0 in 0.143s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8bcdf69e-7e0d-4415-a6bc-074eedd80438 tempest-VolumesExtendTest-1276270698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.570s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:43 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-8bcdf69e-7e0d-4415-a6bc-074eedd80438 tempest-VolumesExtendTest-1276270698 None] Extend volume completed successfully. Jul 14 21:25:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] Acquiring lock "cinder-28c8d247-75ab-4697-ad4d-c2bbc1791a4c-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] Lock "cinder-28c8d247-75ab-4697-ad4d-c2bbc1791a4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] Acquiring lock "cinder-quobyte-48ae0357-6386-47b2-97e5-739812a93b5b" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] Lock "cinder-quobyte-48ae0357-6386-47b2-97e5-739812a93b5b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] Acquiring lock "cinder-quobyte-28c8d247-75ab-4697-ad4d-c2bbc1791a4c" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] Lock "cinder-quobyte-28c8d247-75ab-4697-ad4d-c2bbc1791a4c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] Deleting offline snapshot 28c8d247-75ab-4697-ad4d-c2bbc1791a4c of volume 48ae0357-6386-47b2-97e5-739812a93b5b {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:25:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] snapshot_file for this snap is: volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:25:44 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[97edcfa2-0b9d-4f7a-9d1c-1f07084e1e31]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:44 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c Jul 14 21:25:44 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:45 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c" returned: 0 in 0.418s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:45 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48ae0357-6386-47b2-97e5-739812a93b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:25:45 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[83903015-69b8-4c88-92d8-38a7b6c693cb]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:45 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b Jul 14 21:25:45 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:45 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b" returned: 0 in 0.407s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:45 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c Jul 14 21:25:45 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:46 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c" returned: 0 in 0.488s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:46 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c Jul 14 21:25:46 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:46 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b.28c8d247-75ab-4697-ad4d-c2bbc1791a4c" returned: 0 in 0.277s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] Lock "cinder-quobyte-28c8d247-75ab-4697-ad4d-c2bbc1791a4c" released by "_delete_snapshot" :: held 1.713s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] Lock "cinder-quobyte-48ae0357-6386-47b2-97e5-739812a93b5b" released by "delete_snapshot" :: held 1.738s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:46 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] Created reservations ['00c248f3-294e-45b6-a80e-aebec551b36a', 'b3a5fc24-45a8-492b-bc00-cbfa896785a3', 'd8417828-8557-4564-af9d-4d3e3a1b7801', 'c3f8876c-560a-43b1-981b-fb18ac141fc4'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:25:46 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] Delete snapshot completed successfully. Jul 14 21:25:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f614daca-500c-4035-87cd-a006beef21e6 tempest-VolumesExtendTest-1276270698 None] Lock "cinder-28c8d247-75ab-4697-ad4d-c2bbc1791a4c-delete_snapshot" released by "delete_snapshot" :: held 1.929s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] Acquiring lock "cinder-48ae0357-6386-47b2-97e5-739812a93b5b-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] Lock "cinder-48ae0357-6386-47b2-97e5-739812a93b5b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] Acquiring lock "cinder-quobyte-48ae0357-6386-47b2-97e5-739812a93b5b" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:25:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] Lock "cinder-quobyte-48ae0357-6386-47b2-97e5-739812a93b5b" acquired by "delete_volume" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:25:47 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea62987-d5ee-41c3-9300-dbec19ddf1c6]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:47 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b Jul 14 21:25:47 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:47 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b" returned: 0 in 0.503s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:47 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b Jul 14 21:25:47 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:47 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48ae0357-6386-47b2-97e5-739812a93b5b" returned: 0 in 0.374s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:47 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] Lock "cinder-quobyte-48ae0357-6386-47b2-97e5-739812a93b5b" released by "delete_volume" :: held 0.954s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:48 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] Created reservations ['7242bf8c-7fca-40e5-9909-16b7e121791c', '4e74f936-b262-4653-82b8-c46a997c3866', '0891f2c8-1058-44de-b218-64049c41fc6b', 'c628c590-a498-4770-90a5-92c463d7a826'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:25:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:25:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:25:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:48 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:25:48 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:48 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.258s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:48 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:25:48 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] Deleted volume successfully. Jul 14 21:25:48 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cb5ae463-36b2-4f2f-ab60-73701a1ef3f6 tempest-VolumesExtendTest-1276270698 None] Lock "cinder-48ae0357-6386-47b2-97e5-739812a93b5b-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Flow 'volume_create_manager' (d78fc4c9-8bee-4c24-84a9-2aec308e9fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a82fa2-1a2b-45f9-8ef2-2ed72c8921ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a82fa2-1a2b-45f9-8ef2-2ed72c8921ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-807380565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21751e3-e63c-4098-8432-6e34e0fb3b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64418c0d28124e3c9f03c78527b107a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:25:51Z,use_quota=True,user_id='a646025cb7044ee9bb91d216c04fb910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a2b33d-9de7-4d60-8060-73f75c23b9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a2b33d-9de7-4d60-8060-73f75c23b9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07494fbe-0c92-4227-884e-5ed6dd7fb378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07494fbe-0c92-4227-884e-5ed6dd7fb378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e21751e3-e63c-4098-8432-6e34e0fb3b4b', 'volume_name': 'volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (467a2bb6-7681-4951-8ab3-687f1144c8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (467a2bb6-7681-4951-8ab3-687f1144c8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e959bf54-cad0-4f02-babf-8bdf6b78d377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:50 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Volume e21751e3-e63c-4098-8432-6e34e0fb3b4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b', 'volume_size': 1} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-807380565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e21751e3-e63c-4098-8432-6e34e0fb3b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64418c0d28124e3c9f03c78527b107a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:25:51Z,use_quota=True,user_id='a646025cb7044ee9bb91d216c04fb910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Creating volume e21751e3-e63c-4098-8432-6e34e0fb3b4b {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:25:50 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:25:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:50 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b 1073741824 Jul 14 21:25:50 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:51 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b 1073741824" returned: 0 in 0.533s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:51 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b Jul 14 21:25:51 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:51 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b" returned: 0 in 0.351s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:25:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e959bf54-cad0-4f02-babf-8bdf6b78d377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb60bbb-94a0-428f-a1ec-dd2070b5f5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:51 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Volume volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b (e21751e3-e63c-4098-8432-6e34e0fb3b4b): created successfully Jul 14 21:25:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb60bbb-94a0-428f-a1ec-dd2070b5f5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Flow 'volume_create_manager' (d78fc4c9-8bee-4c24-84a9-2aec308e9fb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:25:51 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-5d5a0172-5c3f-485d-a99f-a06ff084f2c2 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Created volume successfully. Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Flow 'volume_create_manager' (07bc493d-fc0b-4bdd-bc20-d6b1d8347cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df93dd4-9ea6-4441-aa72-501beb1df67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df93dd4-9ea6-4441-aa72-501beb1df67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1172600471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29e9c67-b808-460a-ae0d-aa069a9f9776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f57dae21b374f449bd4900c360aedbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:25:53Z,use_quota=True,user_id='b478f71c36154d5d8fc5a765d0d42eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e26ff38-f615-4190-bd5e-9aa63d5cbab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e26ff38-f615-4190-bd5e-9aa63d5cbab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501f2bfb-2ffa-49c6-8f18-49df45e4b903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501f2bfb-2ffa-49c6-8f18-49df45e4b903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e29e9c67-b808-460a-ae0d-aa069a9f9776', 'volume_name': 'volume-e29e9c67-b808-460a-ae0d-aa069a9f9776', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0202662d-681d-4029-a305-0743fd74ce01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0202662d-681d-4029-a305-0743fd74ce01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e88288e-fea5-414b-b32a-24a7526951d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:52 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Volume e29e9c67-b808-460a-ae0d-aa069a9f9776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e29e9c67-b808-460a-ae0d-aa069a9f9776', 'volume_size': 1} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1172600471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29e9c67-b808-460a-ae0d-aa069a9f9776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f57dae21b374f449bd4900c360aedbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:25:53Z,use_quota=True,user_id='b478f71c36154d5d8fc5a765d0d42eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Creating volume e29e9c67-b808-460a-ae0d-aa069a9f9776 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:25:52 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:25:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e29e9c67-b808-460a-ae0d-aa069a9f9776 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:52 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e29e9c67-b808-460a-ae0d-aa069a9f9776 1073741824 Jul 14 21:25:52 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:53 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e29e9c67-b808-460a-ae0d-aa069a9f9776 1073741824" returned: 0 in 0.612s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e29e9c67-b808-460a-ae0d-aa069a9f9776 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:53 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e29e9c67-b808-460a-ae0d-aa069a9f9776 Jul 14 21:25:53 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:53 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e29e9c67-b808-460a-ae0d-aa069a9f9776" returned: 0 in 0.363s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:25:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e88288e-fea5-414b-b32a-24a7526951d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e29e9c67-b808-460a-ae0d-aa069a9f9776', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7405069e-fd76-4438-9ffa-909db46dfed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:25:53 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Volume volume-e29e9c67-b808-460a-ae0d-aa069a9f9776 (e29e9c67-b808-460a-ae0d-aa069a9f9776): created successfully Jul 14 21:25:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7405069e-fd76-4438-9ffa-909db46dfed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:25:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Flow 'volume_create_manager' (07bc493d-fc0b-4bdd-bc20-d6b1d8347cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:25:53 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-efd13f6f-5cdf-4c44-808a-62c4c305d080 tempest-VolumesNegativeTest-2106712557 None] Created volume successfully. Jul 14 21:25:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-11454b30-2069-417e-ada3-959accaa1781 req-d09e9659-ac35-4660-bf22-85cfd99f2387 tempest-TestStampPattern-1434720668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-11454b30-2069-417e-ada3-959accaa1781 req-d09e9659-ac35-4660-bf22-85cfd99f2387 tempest-TestStampPattern-1434720668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-65cea44a-6f40-4b6d-8883-18962911d3a2 req-fc7e9b64-8052-473d-96b4-5ebe8a2550c8 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:25:54 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e2e4af-4ef8-485a-b2f8-bf728b66aec3]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-11454b30-2069-417e-ada3-959accaa1781 req-d09e9659-ac35-4660-bf22-85cfd99f2387 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:54 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a Jul 14 21:25:54 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:54 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-11454b30-2069-417e-ada3-959accaa1781 req-d09e9659-ac35-4660-bf22-85cfd99f2387 tempest-TestStampPattern-1434720668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a" returned: 0 in 0.419s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-11454b30-2069-417e-ada3-959accaa1781 req-d09e9659-ac35-4660-bf22-85cfd99f2387 tempest-TestStampPattern-1434720668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.441s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-65cea44a-6f40-4b6d-8883-18962911d3a2 req-fc7e9b64-8052-473d-96b4-5ebe8a2550c8 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.430s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:25:54 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62711b8-146b-4ea5-9659-8abaf16f5209]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:25:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-65cea44a-6f40-4b6d-8883-18962911d3a2 req-fc7e9b64-8052-473d-96b4-5ebe8a2550c8 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:25:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-11454b30-2069-417e-ada3-959accaa1781 req-d09e9659-ac35-4660-bf22-85cfd99f2387 tempest-TestStampPattern-1434720668 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c12fd6a7-36b0-4c45-b348-0c00ebc785bb', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:25:54 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-11454b30-2069-417e-ada3-959accaa1781 req-d09e9659-ac35-4660-bf22-85cfd99f2387 tempest-TestStampPattern-1434720668 None] attachment_update completed successfully. Jul 14 21:25:54 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b Jul 14 21:25:54 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:25:54 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jul 14 21:25:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-65cea44a-6f40-4b6d-8883-18962911d3a2 req-fc7e9b64-8052-473d-96b4-5ebe8a2550c8 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b" returned: 0 in 0.443s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:25:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-65cea44a-6f40-4b6d-8883-18962911d3a2 req-fc7e9b64-8052-473d-96b4-5ebe8a2550c8 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.464s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:25:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-65cea44a-6f40-4b6d-8883-18962911d3a2 req-fc7e9b64-8052-473d-96b4-5ebe8a2550c8 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92e386b5-873f-416c-9bce-b128152412d9', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:25:55 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-65cea44a-6f40-4b6d-8883-18962911d3a2 req-fc7e9b64-8052-473d-96b4-5ebe8a2550c8 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] attachment_update completed successfully. Jul 14 21:25:59 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-740afb7c-051d-4029-8a89-6ed578a581ec req-87795570-1929-406a-94ae-cd3c592ef877 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Terminate volume connection completed successfully. Jul 14 21:25:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-740afb7c-051d-4029-8a89-6ed578a581ec req-87795570-1929-406a-94ae-cd3c592ef877 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Deleting attachment 92e386b5-873f-416c-9bce-b128152412d9. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:26:00 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-ed6934c9-73c3-4500-b6a5-5f4fb440b826 req-9f43dc0c-1c03-441a-9632-972f371ce3e4 tempest-TestStampPattern-1434720668 None] Terminate volume connection completed successfully. Jul 14 21:26:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-ed6934c9-73c3-4500-b6a5-5f4fb440b826 req-9f43dc0c-1c03-441a-9632-972f371ce3e4 tempest-TestStampPattern-1434720668 None] Deleting attachment c12fd6a7-36b0-4c45-b348-0c00ebc785bb. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:26:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Acquiring lock "cinder-e21751e3-e63c-4098-8432-6e34e0fb3b4b-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Lock "cinder-e21751e3-e63c-4098-8432-6e34e0fb3b4b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Acquiring lock "cinder-quobyte-e21751e3-e63c-4098-8432-6e34e0fb3b4b" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Lock "cinder-quobyte-e21751e3-e63c-4098-8432-6e34e0fb3b4b" acquired by "delete_volume" :: waited 0.042s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:00 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf63907-29e2-49b2-a376-9b79541fe8d5]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:01 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b Jul 14 21:26:01 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:01 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b" returned: 0 in 0.514s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:01 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b Jul 14 21:26:01 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] Creating offline snapshot 0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 of volume 93cb8dc4-9acf-4594-890c-b3c19755dd1a {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:26:01 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3230166c-ee38-4a74-9654-e6bce9a53995]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:01 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e21751e3-e63c-4098-8432-6e34e0fb3b4b" returned: 0 in 0.380s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Lock "cinder-quobyte-e21751e3-e63c-4098-8432-6e34e0fb3b4b" released by "delete_volume" :: held 0.986s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:01 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Created reservations ['d3bda624-ef03-4ef2-af9b-917a5b369871', 'fcdbbf3b-9efe-4cd1-a526-d975c393cf4b', '22b53748-a369-4968-8b9d-c68394b36277', '9f36d456-0f87-41de-aa9a-3a345503af52'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:26:02 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a Jul 14 21:26:02 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Flow 'volume_create_manager' (1da7bce2-acc2-47f0-ad4d-8d0fcacfab90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcb30fe-c342-48eb-90d7-0923ab4c8150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:02 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:26:02 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcb30fe-c342-48eb-90d7-0923ab4c8150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-637089586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c83f50-4a6f-45a0-aa95-1832c5337cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9375982e7cc41c1b6f7815492fd56cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:02Z,use_quota=True,user_id='77ce073a90b747358f3de5f5308f2fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638cdf8d-1db4-4f28-9fbd-8b50d333ebd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638cdf8d-1db4-4f28-9fbd-8b50d333ebd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344cc427-8c7f-4b91-a0f1-f7c3ed1ebd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344cc427-8c7f-4b91-a0f1-f7c3ed1ebd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c83f50-4a6f-45a0-aa95-1832c5337cd5', 'volume_name': 'volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0014b7b9-54de-4133-b5e9-58c3b72dbf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0014b7b9-54de-4133-b5e9-58c3b72dbf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73e399a-dcda-44d0-9a9d-e133c41d3363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:02 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Volume 61c83f50-4a6f-45a0-aa95-1832c5337cd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5', 'volume_size': 1} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:02 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a" returned: 0 in 0.870s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:02 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 1G Jul 14 21:26:02 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:02 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.569s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:26:02 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Deleted volume successfully. Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3b2455b9-f692-409a-a219-d44310d5e559 tempest-TestServerVolumeAttachScenarioOldVersion-389342178 None] Lock "cinder-e21751e3-e63c-4098-8432-6e34e0fb3b4b-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Flow 'volume_create_manager' (c3df6073-525b-40b3-8060-d130b47c73c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b573246-9cee-4879-9a89-33f4189e1ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b573246-9cee-4879-9a89-33f4189e1ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1753515385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9aaad94-1e6e-4010-8a82-27a3c5e8a106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9375982e7cc41c1b6f7815492fd56cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:03Z,use_quota=True,user_id='77ce073a90b747358f3de5f5308f2fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a355ca-c349-4bc5-9e15-c6591785ff40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a355ca-c349-4bc5-9e15-c6591785ff40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec29d64-83be-441c-afb0-c7598c372153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec29d64-83be-441c-afb0-c7598c372153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9aaad94-1e6e-4010-8a82-27a3c5e8a106', 'volume_name': 'volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afaa29d-2fd3-47e2-a11e-8b8b5ecaa6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afaa29d-2fd3-47e2-a11e-8b8b5ecaa6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25114005-44ff-4352-b69c-be55b8e975b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:03 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Volume b9aaad94-1e6e-4010-8a82-27a3c5e8a106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106', 'volume_size': 1} Jul 14 21:26:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 1G" returned: 0 in 0.774s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:03 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:03 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 Jul 14 21:26:03 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:03 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9" returned: 0 in 0.575s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:03 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 is being set with open permissions: ugo+rw Jul 14 21:26:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:03 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 Jul 14 21:26:03 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:04 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9" returned: 0 in 0.293s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:04 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.info Jul 14 21:26:04 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:04 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.info" returned: 0 in 0.292s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:04 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.info is being set with open permissions: ugo+rw Jul 14 21:26:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:04 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.info Jul 14 21:26:04 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:04 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.info" returned: 0 in 0.347s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.284s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.618s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-637089586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c83f50-4a6f-45a0-aa95-1832c5337cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9375982e7cc41c1b6f7815492fd56cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:02Z,use_quota=True,user_id='77ce073a90b747358f3de5f5308f2fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:26:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Creating volume 61c83f50-4a6f-45a0-aa95-1832c5337cd5 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:26:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:26:04 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:26:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:05 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5 1073741824 Jul 14 21:26:05 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:05 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0aa91e3a-cd81-4f9b-b732-9de794176ce7 tempest-TestStampPattern-1434720668 None] Create snapshot completed successfully Jul 14 21:26:05 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5 1073741824" returned: 0 in 0.547s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:05 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5 Jul 14 21:26:05 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:05 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5" returned: 0 in 0.337s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:26:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.905s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1753515385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9aaad94-1e6e-4010-8a82-27a3c5e8a106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9375982e7cc41c1b6f7815492fd56cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:03Z,use_quota=True,user_id='77ce073a90b747358f3de5f5308f2fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:26:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Creating volume b9aaad94-1e6e-4010-8a82-27a3c5e8a106 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:26:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:26:05 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:26:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73e399a-dcda-44d0-9a9d-e133c41d3363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:06 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106 1073741824 Jul 14 21:26:06 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf36a1c-d9d6-49da-9c40-b0d7c045a61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:06 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Volume volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5 (61c83f50-4a6f-45a0-aa95-1832c5337cd5): created successfully Jul 14 21:26:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf36a1c-d9d6-49da-9c40-b0d7c045a61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Flow 'volume_create_manager' (1da7bce2-acc2-47f0-ad4d-8d0fcacfab90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:06 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d7a37ee4-5055-4f68-95ff-c76ff8e96111 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Created volume successfully. Jul 14 21:26:07 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106 1073741824" returned: 0 in 1.077s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:07 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106 Jul 14 21:26:07 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:07 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106" returned: 0 in 0.602s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:26:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25114005-44ff-4352-b69c-be55b8e975b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0665e6eb-39b3-49ca-9ee5-b0441872468b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:07 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Volume volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106 (b9aaad94-1e6e-4010-8a82-27a3c5e8a106): created successfully Jul 14 21:26:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0665e6eb-39b3-49ca-9ee5-b0441872468b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Flow 'volume_create_manager' (c3df6073-525b-40b3-8060-d130b47c73c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:07 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2bac5c41-de27-4a47-b8a6-672a87fd1ffc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Created volume successfully. Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=92,cinder:INSERT=31,cinder:UPDATE=95,cinder:DELETE=6 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=95,cinder:INSERT=27,cinder:UPDATE=108,cinder:DELETE=12 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Flow 'volume_create_manager' (338558c3-e5d4-4143-a191-eb3d9a68db42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb3d867-1aaf-4407-af0b-6cdba13748c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb3d867-1aaf-4407-af0b-6cdba13748c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1221164858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993b6277-bae0-4ddb-a0e0-5dfdea66ef0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e629ddf61bad43ceb523a1203cbe998a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0f86f52f-6b47-4251-b6fb-8c8dc071b8c9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:17Z,use_quota=True,user_id='764f5012ce114e559b82fe2cb44ddd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463cffed-bfc3-4254-b51d-efc9f8e12036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463cffed-bfc3-4254-b51d-efc9f8e12036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5710da66-09db-4e7f-835d-c5f5f8fa975f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5710da66-09db-4e7f-835d-c5f5f8fa975f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '993b6277-bae0-4ddb-a0e0-5dfdea66ef0c', 'volume_name': 'volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c', 'volume_size': 1, 'snapshot_id': '0f86f52f-6b47-4251-b6fb-8c8dc071b8c9'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3776b5-a1e0-46cc-a68f-aced2902b877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3776b5-a1e0-46cc-a68f-aced2902b877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6adb766-4011-4a46-a62e-80b3771e7bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:17 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Volume 993b6277-bae0-4ddb-a0e0-5dfdea66ef0c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c', 'volume_size': 1, 'snapshot_id': '0f86f52f-6b47-4251-b6fb-8c8dc071b8c9'} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Acquiring lock "cinder-quobyte-0f86f52f-6b47-4251-b6fb-8c8dc071b8c9-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c" by "_create_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Lock "cinder-quobyte-0f86f52f-6b47-4251-b6fb-8c8dc071b8c9-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Creating volume 993b6277-bae0-4ddb-a0e0-5dfdea66ef0c from snapshot 0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 {{(pid=88300) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Acquiring lock "cinder-quobyte-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c" by "_copy_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Lock "cinder-quobyte-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] snapshot: 0f86f52f-6b47-4251-b6fb-8c8dc071b8c9, volume: 993b6277-bae0-4ddb-a0e0-5dfdea66ef0c, {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb8e777-a7d5-4b63-bc7f-bc6725faa5f0]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:17 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 Jul 14 21:26:17 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:18 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9" returned: 0 in 0.885s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:26:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 21:26:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Creating direct copy from snapshot {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 21:26:18 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9481bb-ad9d-443d-8c71-83998bce45e0]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:18 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a Jul 14 21:26:18 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:19 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a" returned: 0 in 0.863s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:19 devstack cinder-volume[88300]: DEBUG cinder.utils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Path /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c not found in is_blk_device check {{(pid=88300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 21:26:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:19 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c Jul 14 21:26:19 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:27 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=2 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:26:27 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=1 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:26:28 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c" returned: 0 in 9.569s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:28 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c001f3e8-0248-4e83-97fd-eb9c0c46efb4]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:29 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a Jul 14 21:26:29 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:30 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a" returned: 0 in 1.468s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:30 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Image conversion details: src /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a, size 1024.00 MB, duration 9.57 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:26:30 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Converted 1024.00 MB image at 107.00 MB/s Jul 14 21:26:30 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c is being set with open permissions: ugo+rw Jul 14 21:26:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:30 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c Jul 14 21:26:30 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:30 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c" returned: 0 in 0.602s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:30 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Lock "cinder-quobyte-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c" released by "_copy_volume_from_snapshot" :: held 13.603s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Lock "cinder-quobyte-0f86f52f-6b47-4251-b6fb-8c8dc071b8c9-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c" released by "_create_volume_from_snapshot" :: held 13.657s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.679s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6adb766-4011-4a46-a62e-80b3771e7bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c', 'volume_size': 1, 'snapshot_id': '0f86f52f-6b47-4251-b6fb-8c8dc071b8c9'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b92e09-ad1f-4491-b435-c809cca3c8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:31 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Volume volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c (993b6277-bae0-4ddb-a0e0-5dfdea66ef0c): created successfully Jul 14 21:26:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b92e09-ad1f-4491-b435-c809cca3c8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Flow 'volume_create_manager' (338558c3-e5d4-4143-a191-eb3d9a68db42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:31 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-ca66bef5-9a00-46c0-8936-770a7d4caae6 tempest-TestStampPattern-1434720668 None] Created volume successfully. Jul 14 21:26:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] Acquiring lock "cinder-e29e9c67-b808-460a-ae0d-aa069a9f9776-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] Lock "cinder-e29e9c67-b808-460a-ae0d-aa069a9f9776-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] Acquiring lock "cinder-quobyte-e29e9c67-b808-460a-ae0d-aa069a9f9776" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] Lock "cinder-quobyte-e29e9c67-b808-460a-ae0d-aa069a9f9776" acquired by "delete_volume" :: waited 0.032s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:34 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bed0940-bb7f-498e-9560-e301e4f77b59]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e29e9c67-b808-460a-ae0d-aa069a9f9776 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:34 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e29e9c67-b808-460a-ae0d-aa069a9f9776 Jul 14 21:26:34 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:35 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e29e9c67-b808-460a-ae0d-aa069a9f9776" returned: 0 in 0.710s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e29e9c67-b808-460a-ae0d-aa069a9f9776 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:35 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e29e9c67-b808-460a-ae0d-aa069a9f9776 Jul 14 21:26:35 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:35 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e29e9c67-b808-460a-ae0d-aa069a9f9776" returned: 0 in 0.448s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] Lock "cinder-quobyte-e29e9c67-b808-460a-ae0d-aa069a9f9776" released by "delete_volume" :: held 1.241s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] Created reservations ['d8327750-d663-42e6-bfcb-94dccea84e22', 'd64aeffa-596b-4cca-b626-396eaf39702b', '397cc390-5d73-4021-92a2-1ea1cdeb2d8f', '98d5f282-0c49-4db9-8717-ac96ac9687de'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Flow 'volume_create_manager' (ccab5bee-a63a-4b28-9d73-25af19ac20a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b133fae-0144-4ab1-b338-146ad61e4126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b133fae-0144-4ab1-b338-146ad61e4126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1988610380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bcb2e6-fead-4d92-9bc3-7a4de42f5b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab431ae20734d21bab6e58d30bcee72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:36Z,use_quota=True,user_id='98ec1e6b29384c1aaad0a2eaa2c6e33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0661e2ed-cd5f-4860-aed8-e992f50bd1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0661e2ed-cd5f-4860-aed8-e992f50bd1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (114c6ff3-3e9b-4e35-af40-412edb08683c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (114c6ff3-3e9b-4e35-af40-412edb08683c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59bcb2e6-fead-4d92-9bc3-7a4de42f5b05', 'volume_name': 'volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ec87fc-b45a-472b-b034-109e453dbcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ec87fc-b45a-472b-b034-109e453dbcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bbe348-2547-495e-ac5e-3d349cac2381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:35 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume 59bcb2e6-fead-4d92-9bc3-7a4de42f5b05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05', 'volume_size': 1} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1988610380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bcb2e6-fead-4d92-9bc3-7a4de42f5b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab431ae20734d21bab6e58d30bcee72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:36Z,use_quota=True,user_id='98ec1e6b29384c1aaad0a2eaa2c6e33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Creating volume 59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:26:35 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:26:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:36 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 1073741824 Jul 14 21:26:36 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:36 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:26:36 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:36 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.260s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:26:36 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] Deleted volume successfully. Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2535cea6-3417-48f5-b2e6-8d5cc4e0c5c6 tempest-VolumesNegativeTest-2106712557 None] Lock "cinder-e29e9c67-b808-460a-ae0d-aa069a9f9776-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:36 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 1073741824" returned: 0 in 0.512s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:36 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:36 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:36 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:26:36 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:37 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05" returned: 0 in 0.478s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:26:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bbe348-2547-495e-ac5e-3d349cac2381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86b9b17-adc6-4711-8cd6-047921577c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:37 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:37 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 (59bcb2e6-fead-4d92-9bc3-7a4de42f5b05): created successfully Jul 14 21:26:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86b9b17-adc6-4711-8cd6-047921577c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Flow 'volume_create_manager' (ccab5bee-a63a-4b28-9d73-25af19ac20a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.502s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:37 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:26:37 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:26:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 28 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:26:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:26:37 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-6732f4b1-b92e-4e86-9048-8f8e972f4509 tempest-CreateVolumesFromSnapshotTest-935989315 None] Created volume successfully. Jul 14 21:26:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] Creating offline snapshot 26c11b44-9234-423a-b9a1-88e762fbf8d8 of volume 59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:26:38 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c129768-735f-4e47-9ffe-f928cbd5bc5d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:38 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 Jul 14 21:26:38 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:39 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05" returned: 0 in 0.753s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:39 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8 1G Jul 14 21:26:39 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:39 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8 1G" returned: 0 in 0.726s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:39 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8 Jul 14 21:26:39 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:40 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8" returned: 0 in 0.590s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:40 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8 is being set with open permissions: ugo+rw Jul 14 21:26:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:40 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8 Jul 14 21:26:40 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:40 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8" returned: 0 in 0.461s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:41 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.info Jul 14 21:26:41 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Flow 'volume_create_manager' (0b31da81-44b0-457e-bbc7-0aace77262ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2860962-67d2-4c42-b902-193573f915e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2860962-67d2-4c42-b902-193573f915e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1149765226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ce0ce8-ba9f-48a0-8c51-ca67a0385990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5921c623056a4c4888910ac8ec99f19d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:41Z,use_quota=True,user_id='db441a77ab1942bea666b39de36c54d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de77ab1f-871a-4be0-896f-a0d5257112da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de77ab1f-871a-4be0-896f-a0d5257112da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27c2b76-540e-481e-950e-131ad1185e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27c2b76-540e-481e-950e-131ad1185e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4ce0ce8-ba9f-48a0-8c51-ca67a0385990', 'volume_name': 'volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b08193-4ae7-4100-8432-5429c00117bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b08193-4ae7-4100-8432-5429c00117bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef04b512-d6f7-4eb9-ac21-502bfd0664b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:41 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Volume f4ce0ce8-ba9f-48a0-8c51-ca67a0385990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990', 'volume_size': 1} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:41 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.info" returned: 0 in 0.332s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:41 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.info is being set with open permissions: ugo+rw Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:41 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.info Jul 14 21:26:41 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:41 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.info" returned: 0 in 0.296s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.285s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.380s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1149765226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ce0ce8-ba9f-48a0-8c51-ca67a0385990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5921c623056a4c4888910ac8ec99f19d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:41Z,use_quota=True,user_id='db441a77ab1942bea666b39de36c54d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Creating volume f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:26:41 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:26:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:41 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 1073741824 Jul 14 21:26:41 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:41 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-92ba7951-48c4-4875-be5e-b914d8339061 tempest-CreateVolumesFromSnapshotTest-935989315 None] Create snapshot completed successfully Jul 14 21:26:42 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 1073741824" returned: 0 in 0.560s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:42 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 Jul 14 21:26:42 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-2337caa8-b498-4d53-84d1-5c1715b35715 req-5e6aa14b-778e-480a-8fec-fddb76b2c3c3 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:42 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990" returned: 0 in 0.279s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:42 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:26:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-2337caa8-b498-4d53-84d1-5c1715b35715 req-5e6aa14b-778e-480a-8fec-fddb76b2c3c3 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.134s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:42 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef04b512-d6f7-4eb9-ac21-502bfd0664b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:42 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce0628e-6c9b-4282-8a16-529266c8f9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:42 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Volume volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 (f4ce0ce8-ba9f-48a0-8c51-ca67a0385990): created successfully Jul 14 21:26:42 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce0628e-6c9b-4282-8a16-529266c8f9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:42 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Flow 'volume_create_manager' (0b31da81-44b0-457e-bbc7-0aace77262ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:42 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc97178b-2afe-46db-a21f-ec8855b2e327]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-2337caa8-b498-4d53-84d1-5c1715b35715 req-5e6aa14b-778e-480a-8fec-fddb76b2c3c3 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:42 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f33c9ded-5cd0-4261-9439-fa74647feea7 tempest-VolumesSnapshotListTestJSON-1401366895 None] Created volume successfully. Jul 14 21:26:42 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5 Jul 14 21:26:42 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:43 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-2337caa8-b498-4d53-84d1-5c1715b35715 req-5e6aa14b-778e-480a-8fec-fddb76b2c3c3 tempest-TestServerVolumeAttachmentScenario-2143123397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5" returned: 0 in 0.382s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-2337caa8-b498-4d53-84d1-5c1715b35715 req-5e6aa14b-778e-480a-8fec-fddb76b2c3c3 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.438s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-2337caa8-b498-4d53-84d1-5c1715b35715 req-5e6aa14b-778e-480a-8fec-fddb76b2c3c3 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac760f7e-2449-4193-b54f-8967272fc233', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:26:43 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-2337caa8-b498-4d53-84d1-5c1715b35715 req-5e6aa14b-778e-480a-8fec-fddb76b2c3c3 tempest-TestServerVolumeAttachmentScenario-2143123397 None] attachment_update completed successfully. Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Flow 'volume_create_manager' (001cda43-df4a-4cf1-9e3c-18738604ead8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ed3456-82d9-4ecd-a0b6-b853a2f2f997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ed3456-82d9-4ecd-a0b6-b853a2f2f997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-277169129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b531721a-fbc1-44bd-82ac-dc9fe9d89356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab431ae20734d21bab6e58d30bcee72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:43Z,use_quota=True,user_id='98ec1e6b29384c1aaad0a2eaa2c6e33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62893440-a755-4ad7-943f-bf69126c2d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62893440-a755-4ad7-943f-bf69126c2d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf8d509-a4c1-40c7-a134-eeb06cebe625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf8d509-a4c1-40c7-a134-eeb06cebe625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b531721a-fbc1-44bd-82ac-dc9fe9d89356', 'volume_name': 'volume-b531721a-fbc1-44bd-82ac-dc9fe9d89356', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97fbf37-5246-4a76-9636-b1d7a9ea41a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97fbf37-5246-4a76-9636-b1d7a9ea41a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca3b9ba-0ca1-4350-8baf-09aa9d1236ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:43 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume b531721a-fbc1-44bd-82ac-dc9fe9d89356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b531721a-fbc1-44bd-82ac-dc9fe9d89356', 'volume_size': 1} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-277169129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b531721a-fbc1-44bd-82ac-dc9fe9d89356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab431ae20734d21bab6e58d30bcee72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:43Z,use_quota=True,user_id='98ec1e6b29384c1aaad0a2eaa2c6e33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Creating volume b531721a-fbc1-44bd-82ac-dc9fe9d89356 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:26:43 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b531721a-fbc1-44bd-82ac-dc9fe9d89356 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:43 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b531721a-fbc1-44bd-82ac-dc9fe9d89356 1073741824 Jul 14 21:26:43 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Flow 'volume_create_manager' (14b5d05d-58c3-44f2-abd2-8748d0d74599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807b1a0b-4ce6-422a-8a58-d919edc6cb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807b1a0b-4ce6-422a-8a58-d919edc6cb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-766563841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9c9677-826f-4cb3-bab5-68a27cfdb5e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab431ae20734d21bab6e58d30bcee72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:44Z,use_quota=True,user_id='98ec1e6b29384c1aaad0a2eaa2c6e33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07277290-4a4a-4d2c-b48f-dd087e23733e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07277290-4a4a-4d2c-b48f-dd087e23733e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237b3edd-17f5-48af-9eb9-62a0443a6556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237b3edd-17f5-48af-9eb9-62a0443a6556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9c9677-826f-4cb3-bab5-68a27cfdb5e8', 'volume_name': 'volume-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b2fa29-ff90-4e1b-bd5a-7e7bca930bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b2fa29-ff90-4e1b-bd5a-7e7bca930bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2827816-cbb9-4b50-8330-80f669e48c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:44 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume cd9c9677-826f-4cb3-bab5-68a27cfdb5e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8', 'volume_size': 1} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:44 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b531721a-fbc1-44bd-82ac-dc9fe9d89356 1073741824" returned: 0 in 0.818s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b531721a-fbc1-44bd-82ac-dc9fe9d89356 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:44 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b531721a-fbc1-44bd-82ac-dc9fe9d89356 Jul 14 21:26:44 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:44 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b531721a-fbc1-44bd-82ac-dc9fe9d89356" returned: 0 in 0.420s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.587s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-766563841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9c9677-826f-4cb3-bab5-68a27cfdb5e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab431ae20734d21bab6e58d30bcee72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:44Z,use_quota=True,user_id='98ec1e6b29384c1aaad0a2eaa2c6e33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Creating volume cd9c9677-826f-4cb3-bab5-68a27cfdb5e8 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:26:44 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:44 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8 1073741824 Jul 14 21:26:44 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca3b9ba-0ca1-4350-8baf-09aa9d1236ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b531721a-fbc1-44bd-82ac-dc9fe9d89356', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee8357d-1303-4808-bb39-487fb6daff9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Flow 'volume_create_manager' (e6ae424f-f234-4ee3-804e-68e6be1d833c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5dbbca8-4544-4ba6-82ac-248204354787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:44 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume volume-b531721a-fbc1-44bd-82ac-dc9fe9d89356 (b531721a-fbc1-44bd-82ac-dc9fe9d89356): created successfully Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee8357d-1303-4808-bb39-487fb6daff9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Flow 'volume_create_manager' (001cda43-df4a-4cf1-9e3c-18738604ead8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5dbbca8-4544-4ba6-82ac-248204354787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1349315506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf708f2-1402-47d4-bf74-82b85408eb65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab431ae20734d21bab6e58d30bcee72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:45Z,use_quota=True,user_id='98ec1e6b29384c1aaad0a2eaa2c6e33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845e6f0c-b513-41be-94b6-c50e3e8ef752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845e6f0c-b513-41be-94b6-c50e3e8ef752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da02b50-689b-4e1a-98d3-73c9eba26a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da02b50-689b-4e1a-98d3-73c9eba26a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf708f2-1402-47d4-bf74-82b85408eb65', 'volume_name': 'volume-abf708f2-1402-47d4-bf74-82b85408eb65', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f66be35-cb17-433e-82f7-0b88c50c377a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f66be35-cb17-433e-82f7-0b88c50c377a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b7d2dc-30a0-4d1f-ae83-5adc7d81baa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:45 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume abf708f2-1402-47d4-bf74-82b85408eb65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf708f2-1402-47d4-bf74-82b85408eb65', 'volume_size': 1} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:45 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-1da0ce68-eac2-4e35-95e3-35bb34839d18 tempest-CreateVolumesFromSnapshotTest-935989315 None] Created volume successfully. Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Flow 'volume_create_manager' (a12cb8f1-a9c2-4297-8129-63c66bf3ae39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50966c56-e676-4db5-ac57-ecbbbc368cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50966c56-e676-4db5-ac57-ecbbbc368cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-671681327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a31d37-d5a1-4970-84c4-7d80fb42af5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab431ae20734d21bab6e58d30bcee72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:45Z,use_quota=True,user_id='98ec1e6b29384c1aaad0a2eaa2c6e33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d974412-888f-49a3-8f81-06aa38b951ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d974412-888f-49a3-8f81-06aa38b951ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e817449-0331-4933-b0c3-9accaa148985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e817449-0331-4933-b0c3-9accaa148985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a31d37-d5a1-4970-84c4-7d80fb42af5d', 'volume_name': 'volume-e7a31d37-d5a1-4970-84c4-7d80fb42af5d', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a06dd9-ae3c-4a8a-8338-ec82875ea7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a06dd9-ae3c-4a8a-8338-ec82875ea7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a22c4fb-52d5-4278-a786-bdfd3d4dbec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:45 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume e7a31d37-d5a1-4970-84c4-7d80fb42af5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a31d37-d5a1-4970-84c4-7d80fb42af5d', 'volume_size': 1} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:45 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8 1073741824" returned: 0 in 0.675s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:45 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8 Jul 14 21:26:45 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Flow 'volume_create_manager' (53eada60-4e51-41d1-a9da-7b7a07dce75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (301e82d4-31c9-4e14-8604-cd7eda3af074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (301e82d4-31c9-4e14-8604-cd7eda3af074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1566197586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf69170-230b-45f8-8115-597caa0f331a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab431ae20734d21bab6e58d30bcee72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:45Z,use_quota=True,user_id='98ec1e6b29384c1aaad0a2eaa2c6e33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5264ebe-061c-4dec-8ecc-ac80445e7229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5264ebe-061c-4dec-8ecc-ac80445e7229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf2821c-5f16-4cbf-934e-b6c7d3fae8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf2821c-5f16-4cbf-934e-b6c7d3fae8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecf69170-230b-45f8-8115-597caa0f331a', 'volume_name': 'volume-ecf69170-230b-45f8-8115-597caa0f331a', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52cfeb6f-ba8a-45d5-8549-b97599ed09f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52cfeb6f-ba8a-45d5-8549-b97599ed09f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b161eed-9dd1-4300-bc7c-7239decbb929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:45 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume ecf69170-230b-45f8-8115-597caa0f331a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecf69170-230b-45f8-8115-597caa0f331a', 'volume_size': 1} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:45 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8" returned: 0 in 0.390s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.711s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] Creating offline snapshot aa1597d9-c236-49c1-a2db-8052ff936c1a of volume f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2827816-cbb9-4b50-8330-80f669e48c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f721297b-63fd-4e70-bc22-e35c76eb3d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec84415-168a-49fb-a1c1-5685ddfd1d20]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:45 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume volume-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8 (cd9c9677-826f-4cb3-bab5-68a27cfdb5e8): created successfully Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f721297b-63fd-4e70-bc22-e35c76eb3d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Flow 'volume_create_manager' (14b5d05d-58c3-44f2-abd2-8748d0d74599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:45 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-b7c682e4-cf6a-4494-89e6-6ce1de02827c tempest-CreateVolumesFromSnapshotTest-935989315 None] Created volume successfully. Jul 14 21:26:45 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 Jul 14 21:26:45 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:46 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990" returned: 0 in 0.414s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:46 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a 1G Jul 14 21:26:46 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:46 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a 1G" returned: 0 in 0.466s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:46 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a Jul 14 21:26:46 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:47 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a" returned: 0 in 0.346s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:47 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a is being set with open permissions: ugo+rw Jul 14 21:26:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:47 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a Jul 14 21:26:47 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:47 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a" returned: 0 in 0.308s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:47 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.info Jul 14 21:26:47 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:47 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.info" returned: 0 in 0.296s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:47 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.info is being set with open permissions: ugo+rw Jul 14 21:26:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:47 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.info Jul 14 21:26:47 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:48 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.info" returned: 0 in 0.308s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.238s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.020s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1349315506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf708f2-1402-47d4-bf74-82b85408eb65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab431ae20734d21bab6e58d30bcee72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:45Z,use_quota=True,user_id='98ec1e6b29384c1aaad0a2eaa2c6e33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Creating volume abf708f2-1402-47d4-bf74-82b85408eb65 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:26:48 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-abf708f2-1402-47d4-bf74-82b85408eb65 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:48 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-abf708f2-1402-47d4-bf74-82b85408eb65 1073741824 Jul 14 21:26:48 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:48 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-4d81f2c8-d040-4136-811d-7c21e27879e6 tempest-VolumesSnapshotListTestJSON-1401366895 None] Create snapshot completed successfully Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-310b19c2-10cd-426b-85a4-442b4fb106b4 tempest-VolumesSnapshotListTestJSON-1401366895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-bb4ea446-8772-4831-a7da-3cf5ec7066ed req-fd4dc900-0f55-4d95-b070-c1f756f5f1e5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:48 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-abf708f2-1402-47d4-bf74-82b85408eb65 1073741824" returned: 0 in 0.594s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-abf708f2-1402-47d4-bf74-82b85408eb65 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:48 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-abf708f2-1402-47d4-bf74-82b85408eb65 Jul 14 21:26:48 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:48 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-abf708f2-1402-47d4-bf74-82b85408eb65" returned: 0 in 0.241s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.741s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-671681327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a31d37-d5a1-4970-84c4-7d80fb42af5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab431ae20734d21bab6e58d30bcee72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:45Z,use_quota=True,user_id='98ec1e6b29384c1aaad0a2eaa2c6e33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Creating volume e7a31d37-d5a1-4970-84c4-7d80fb42af5d {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:26:48 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7a31d37-d5a1-4970-84c4-7d80fb42af5d 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b7d2dc-30a0-4d1f-ae83-5adc7d81baa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf708f2-1402-47d4-bf74-82b85408eb65', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:48 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7a31d37-d5a1-4970-84c4-7d80fb42af5d 1073741824 Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2150ca7-0db8-4237-b444-c2a96952dc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:48 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:48 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume volume-abf708f2-1402-47d4-bf74-82b85408eb65 (abf708f2-1402-47d4-bf74-82b85408eb65): created successfully Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2150ca7-0db8-4237-b444-c2a96952dc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:48 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Flow 'volume_create_manager' (e6ae424f-f234-4ee3-804e-68e6be1d833c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:49 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f4923d39-1072-40ab-96a8-6cbd51ca0a2b tempest-CreateVolumesFromSnapshotTest-935989315 None] Created volume successfully. Jul 14 21:26:49 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7a31d37-d5a1-4970-84c4-7d80fb42af5d 1073741824" returned: 0 in 0.415s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7a31d37-d5a1-4970-84c4-7d80fb42af5d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:49 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7a31d37-d5a1-4970-84c4-7d80fb42af5d Jul 14 21:26:49 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:49 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7a31d37-d5a1-4970-84c4-7d80fb42af5d" returned: 0 in 0.242s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.975s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1566197586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf69170-230b-45f8-8115-597caa0f331a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab431ae20734d21bab6e58d30bcee72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:26:45Z,use_quota=True,user_id='98ec1e6b29384c1aaad0a2eaa2c6e33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Creating volume ecf69170-230b-45f8-8115-597caa0f331a {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:26:49 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ecf69170-230b-45f8-8115-597caa0f331a 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:49 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ecf69170-230b-45f8-8115-597caa0f331a 1073741824 Jul 14 21:26:49 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a22c4fb-52d5-4278-a786-bdfd3d4dbec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a31d37-d5a1-4970-84c4-7d80fb42af5d', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6cdb80-1836-4b47-b018-9b465626565f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:49 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume volume-e7a31d37-d5a1-4970-84c4-7d80fb42af5d (e7a31d37-d5a1-4970-84c4-7d80fb42af5d): created successfully Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6cdb80-1836-4b47-b018-9b465626565f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Flow 'volume_create_manager' (a12cb8f1-a9c2-4297-8129-63c66bf3ae39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:49 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-ee355abc-f453-47bb-ab72-ef7085ca6580 tempest-CreateVolumesFromSnapshotTest-935989315 None] Created volume successfully. Jul 14 21:26:50 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ecf69170-230b-45f8-8115-597caa0f331a 1073741824" returned: 0 in 0.419s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ecf69170-230b-45f8-8115-597caa0f331a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:50 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ecf69170-230b-45f8-8115-597caa0f331a Jul 14 21:26:50 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:50 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ecf69170-230b-45f8-8115-597caa0f331a" returned: 0 in 0.241s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:26:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-310b19c2-10cd-426b-85a4-442b4fb106b4 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.745s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b161eed-9dd1-4300-bc7c-7239decbb929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecf69170-230b-45f8-8115-597caa0f331a', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34434dfd-875d-4d57-976f-c0845e2aef12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:26:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-310b19c2-10cd-426b-85a4-442b4fb106b4 tempest-VolumesSnapshotListTestJSON-1401366895 None] Creating offline snapshot 88ff40b1-1f40-4b98-b333-84d4844d736a of volume f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:26:50 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Volume volume-ecf69170-230b-45f8-8115-597caa0f331a (ecf69170-230b-45f8-8115-597caa0f331a): created successfully Jul 14 21:26:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34434dfd-875d-4d57-976f-c0845e2aef12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:26:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Flow 'volume_create_manager' (53eada60-4e51-41d1-a9da-7b7a07dce75e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:26:50 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f27f603-f81c-4eec-9a57-032c3288187f]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-310b19c2-10cd-426b-85a4-442b4fb106b4 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:50 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a55082fa-3d31-4c3e-9ae2-299c22d496ee tempest-CreateVolumesFromSnapshotTest-935989315 None] Created volume successfully. Jul 14 21:26:50 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a Jul 14 21:26:50 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:50 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-310b19c2-10cd-426b-85a4-442b4fb106b4 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a" returned: 0 in 0.352s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-310b19c2-10cd-426b-85a4-442b4fb106b4 tempest-VolumesSnapshotListTestJSON-1401366895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:26:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-310b19c2-10cd-426b-85a4-442b4fb106b4 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:50 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a 1G Jul 14 21:26:50 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "cinder-ecf69170-230b-45f8-8115-597caa0f331a-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-ecf69170-230b-45f8-8115-597caa0f331a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "cinder-quobyte-ecf69170-230b-45f8-8115-597caa0f331a" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-quobyte-ecf69170-230b-45f8-8115-597caa0f331a" acquired by "delete_volume" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:51 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-310b19c2-10cd-426b-85a4-442b4fb106b4 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a 1G" returned: 0 in 0.463s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-310b19c2-10cd-426b-85a4-442b4fb106b4 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[402fc841-f606-475e-9a8e-e9d881fc548b]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ecf69170-230b-45f8-8115-597caa0f331a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:51 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a Jul 14 21:26:51 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:51 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ecf69170-230b-45f8-8115-597caa0f331a Jul 14 21:26:51 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:51 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-310b19c2-10cd-426b-85a4-442b4fb106b4 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a" returned: 0 in 0.292s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:51 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-310b19c2-10cd-426b-85a4-442b4fb106b4 tempest-VolumesSnapshotListTestJSON-1401366895 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a is being set with open permissions: ugo+rw Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-310b19c2-10cd-426b-85a4-442b4fb106b4 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:51 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a Jul 14 21:26:51 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:51 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ecf69170-230b-45f8-8115-597caa0f331a" returned: 0 in 0.367s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ecf69170-230b-45f8-8115-597caa0f331a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:51 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ecf69170-230b-45f8-8115-597caa0f331a Jul 14 21:26:51 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:51 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-310b19c2-10cd-426b-85a4-442b4fb106b4 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a" returned: 0 in 0.248s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-310b19c2-10cd-426b-85a4-442b4fb106b4 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.474s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-bb4ea446-8772-4831-a7da-3cf5ec7066ed req-fd4dc900-0f55-4d95-b070-c1f756f5f1e5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.182s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e8f28f-a3ef-461a-973e-f5d5b2aa815f]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-bb4ea446-8772-4831-a7da-3cf5ec7066ed req-fd4dc900-0f55-4d95-b070-c1f756f5f1e5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:51 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-310b19c2-10cd-426b-85a4-442b4fb106b4 tempest-VolumesSnapshotListTestJSON-1401366895 None] Create snapshot completed successfully Jul 14 21:26:51 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-ecf69170-230b-45f8-8115-597caa0f331a" returned: 0 in 0.251s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-quobyte-ecf69170-230b-45f8-8115-597caa0f331a" released by "delete_volume" :: held 0.670s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] Created reservations ['5a044e82-b670-402e-87b7-41d0e318f659', '31ac185e-acf3-4d65-99b6-398f0c56ba26', '11b9c9ea-e026-4041-91a5-8ef4596cad8b', '8e6139c2-3a69-4613-8ff7-cf7f26826abe'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:26:51 devstack sudo[103091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106 Jul 14 21:26:51 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:52 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:26:52 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:52 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-bb4ea446-8772-4831-a7da-3cf5ec7066ed req-fd4dc900-0f55-4d95-b070-c1f756f5f1e5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106" returned: 0 in 0.368s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-bb4ea446-8772-4831-a7da-3cf5ec7066ed req-fd4dc900-0f55-4d95-b070-c1f756f5f1e5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.390s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-bb4ea446-8772-4831-a7da-3cf5ec7066ed req-fd4dc900-0f55-4d95-b070-c1f756f5f1e5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f86d3de-a651-4c84-9439-8f0db9d9ab87', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:26:52 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.266s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:26:52 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] Deleted volume successfully. Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c9539e21-a333-4e55-9ada-8fa4bf2b8d5a tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-ecf69170-230b-45f8-8115-597caa0f331a-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "cinder-e7a31d37-d5a1-4970-84c4-7d80fb42af5d-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-e7a31d37-d5a1-4970-84c4-7d80fb42af5d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:52 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-bb4ea446-8772-4831-a7da-3cf5ec7066ed req-fd4dc900-0f55-4d95-b070-c1f756f5f1e5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] attachment_update completed successfully. Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "cinder-quobyte-e7a31d37-d5a1-4970-84c4-7d80fb42af5d" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-quobyte-e7a31d37-d5a1-4970-84c4-7d80fb42af5d" acquired by "delete_volume" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdf37f9-b631-4255-a755-d0a5c71c28ba]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7a31d37-d5a1-4970-84c4-7d80fb42af5d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:52 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7a31d37-d5a1-4970-84c4-7d80fb42af5d Jul 14 21:26:52 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:52 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7a31d37-d5a1-4970-84c4-7d80fb42af5d" returned: 0 in 0.409s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7a31d37-d5a1-4970-84c4-7d80fb42af5d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:52 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7a31d37-d5a1-4970-84c4-7d80fb42af5d Jul 14 21:26:52 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-89ab0c47-c497-4845-9d80-5f2f223b4428 tempest-VolumesSnapshotListTestJSON-1401366895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-89ab0c47-c497-4845-9d80-5f2f223b4428 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-89ab0c47-c497-4845-9d80-5f2f223b4428 tempest-VolumesSnapshotListTestJSON-1401366895 None] Creating offline snapshot e9003f72-2760-406a-9eb8-b2aa7fc2c412 of volume f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb73a7d-d0a2-4bfe-8ae4-89fba6d4201e]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89ab0c47-c497-4845-9d80-5f2f223b4428 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:53 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7a31d37-d5a1-4970-84c4-7d80fb42af5d" returned: 0 in 0.287s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-quobyte-e7a31d37-d5a1-4970-84c4-7d80fb42af5d" released by "delete_volume" :: held 0.738s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:53 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a Jul 14 21:26:53 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] Created reservations ['5d2a7f55-7e32-464c-9ced-0965c09c7827', '7f8140be-0019-46bf-901c-e19899635613', 'be89e675-26bb-4ff0-86c8-34ab8c757599', '12172527-f924-452f-a93e-29fb6043aa16'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:53 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:26:53 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:53 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89ab0c47-c497-4845-9d80-5f2f223b4428 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a" returned: 0 in 0.379s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-89ab0c47-c497-4845-9d80-5f2f223b4428 tempest-VolumesSnapshotListTestJSON-1401366895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89ab0c47-c497-4845-9d80-5f2f223b4428 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:53 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412 1G Jul 14 21:26:53 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:53 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.254s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:26:53 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] Deleted volume successfully. Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "cinder-abf708f2-1402-47d4-bf74-82b85408eb65-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8e240a49-e1db-4113-bcbb-23e4c01fbb8e tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-e7a31d37-d5a1-4970-84c4-7d80fb42af5d-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-abf708f2-1402-47d4-bf74-82b85408eb65-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "cinder-quobyte-abf708f2-1402-47d4-bf74-82b85408eb65" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-quobyte-abf708f2-1402-47d4-bf74-82b85408eb65" acquired by "delete_volume" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f7da38-9b9e-4fcd-ad1f-a049f8432f8a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-abf708f2-1402-47d4-bf74-82b85408eb65 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:53 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-abf708f2-1402-47d4-bf74-82b85408eb65 Jul 14 21:26:53 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:54 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89ab0c47-c497-4845-9d80-5f2f223b4428 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412 1G" returned: 0 in 0.617s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89ab0c47-c497-4845-9d80-5f2f223b4428 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:54 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412 Jul 14 21:26:54 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:54 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-abf708f2-1402-47d4-bf74-82b85408eb65" returned: 0 in 0.438s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-abf708f2-1402-47d4-bf74-82b85408eb65 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:54 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-abf708f2-1402-47d4-bf74-82b85408eb65 Jul 14 21:26:54 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:54 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-abf708f2-1402-47d4-bf74-82b85408eb65" returned: 0 in 0.268s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:54 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89ab0c47-c497-4845-9d80-5f2f223b4428 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412" returned: 0 in 0.350s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:54 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-89ab0c47-c497-4845-9d80-5f2f223b4428 tempest-VolumesSnapshotListTestJSON-1401366895 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412 is being set with open permissions: ugo+rw Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89ab0c47-c497-4845-9d80-5f2f223b4428 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-quobyte-abf708f2-1402-47d4-bf74-82b85408eb65" released by "delete_volume" :: held 0.775s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:54 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412 Jul 14 21:26:54 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] Created reservations ['e0736db1-57e7-43ca-8aeb-4315fdf593fc', 'a233cf55-4fc8-440d-ba1e-2f06ea5adcf5', 'f4f0832e-0d9f-4777-b9e5-1a3cf5690d68', '6664e609-837b-4c1e-9e9e-087a6ee69217'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:26:54 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-66abdf4d-7cdf-4baf-ad57-60459f896079 req-9ab51be2-1ccc-4739-9357-98cab4b9b115 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Terminate volume connection completed successfully. Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-66abdf4d-7cdf-4baf-ad57-60459f896079 req-9ab51be2-1ccc-4739-9357-98cab4b9b115 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Deleting attachment 3f86d3de-a651-4c84-9439-8f0db9d9ab87. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:54 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:26:54 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:54 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-89ab0c47-c497-4845-9d80-5f2f223b4428 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412" returned: 0 in 0.291s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-89ab0c47-c497-4845-9d80-5f2f223b4428 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.748s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "cinder-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:54 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-89ab0c47-c497-4845-9d80-5f2f223b4428 tempest-VolumesSnapshotListTestJSON-1401366895 None] Create snapshot completed successfully Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "cinder-quobyte-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-quobyte-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8" acquired by "delete_volume" :: waited 0.012s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1f392b-a740-48ba-9ff4-b600992a7206]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:54 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.300s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:26:54 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] Deleted volume successfully. Jul 14 21:26:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6017484b-4a06-4a2b-934c-67a059218ba7 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-abf708f2-1402-47d4-bf74-82b85408eb65-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:54 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8 Jul 14 21:26:54 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:55 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8" returned: 0 in 0.392s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:55 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8 Jul 14 21:26:55 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:55 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8" returned: 0 in 0.294s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-quobyte-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8" released by "delete_volume" :: held 0.731s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:55 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] Created reservations ['b6823133-c3e8-4017-82a5-0c45085250ea', '9dd2401b-b704-4adc-8eff-c574481920b2', 'ed1859ae-1503-4333-8da1-53d8da7fea70', '6b56ab43-59c6-4b8f-aabc-225c00ce05dd'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:26:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:55 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:55 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:55 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:26:55 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Acquiring lock "cinder-e9003f72-2760-406a-9eb8-b2aa7fc2c412-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-e9003f72-2760-406a-9eb8-b2aa7fc2c412-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Acquiring lock "cinder-quobyte-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "cinder-b531721a-fbc1-44bd-82ac-dc9fe9d89356-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-quobyte-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Acquiring lock "cinder-quobyte-e9003f72-2760-406a-9eb8-b2aa7fc2c412" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-b531721a-fbc1-44bd-82ac-dc9fe9d89356-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:56 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-quobyte-e9003f72-2760-406a-9eb8-b2aa7fc2c412" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Deleting offline snapshot e9003f72-2760-406a-9eb8-b2aa7fc2c412 of volume f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] snapshot_file for this snap is: volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.382s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:26:56 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] Deleted volume successfully. Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dc45ff-629c-41f9-ad05-84f26f2181e0]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "cinder-quobyte-b531721a-fbc1-44bd-82ac-dc9fe9d89356" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3c3f7d2c-30b4-497e-8c4a-abc92d90cc14 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-cd9c9677-826f-4cb3-bab5-68a27cfdb5e8-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-quobyte-b531721a-fbc1-44bd-82ac-dc9fe9d89356" acquired by "delete_volume" :: waited 0.036s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:56 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-e7a87692-c684-4787-bf5b-99661b92c7cc req-3fc975ac-e925-4523-ad13-ae4fd872a33f tempest-TestServerVolumeAttachmentScenario-2143123397 None] Terminate volume connection completed successfully. Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-e7a87692-c684-4787-bf5b-99661b92c7cc req-3fc975ac-e925-4523-ad13-ae4fd872a33f tempest-TestServerVolumeAttachmentScenario-2143123397 None] Deleting attachment ac760f7e-2449-4193-b54f-8967272fc233. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e981682-8410-482b-a59c-554c4a27f1b8]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b531721a-fbc1-44bd-82ac-dc9fe9d89356 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:56 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412 Jul 14 21:26:56 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:56 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b531721a-fbc1-44bd-82ac-dc9fe9d89356 Jul 14 21:26:56 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:56 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412" returned: 0 in 0.402s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdfea1f-51a5-405d-abe7-256ec7ed66c9]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:56 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b531721a-fbc1-44bd-82ac-dc9fe9d89356" returned: 0 in 0.414s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b531721a-fbc1-44bd-82ac-dc9fe9d89356 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:56 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b531721a-fbc1-44bd-82ac-dc9fe9d89356 Jul 14 21:26:56 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:56 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a Jul 14 21:26:56 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:56 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b531721a-fbc1-44bd-82ac-dc9fe9d89356" returned: 0 in 0.291s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-quobyte-b531721a-fbc1-44bd-82ac-dc9fe9d89356" released by "delete_volume" :: held 0.751s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:56 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a" returned: 0 in 0.378s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:56 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412 Jul 14 21:26:56 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:56 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] Created reservations ['b9be795b-011a-42db-b555-5185a4222ab9', '7a090262-6948-4367-ba96-a78048a7e741', '90050915-7be7-4a39-8378-d883ef0665d1', '5756f5a0-c8ab-4f5d-8093-b31fb9de0de3'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:57 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:26:57 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "cinder-26c11b44-9234-423a-b9a1-88e762fbf8d8-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-26c11b44-9234-423a-b9a1-88e762fbf8d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "cinder-quobyte-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-quobyte-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "cinder-quobyte-26c11b44-9234-423a-b9a1-88e762fbf8d8" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-quobyte-26c11b44-9234-423a-b9a1-88e762fbf8d8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] Deleting offline snapshot 26c11b44-9234-423a-b9a1-88e762fbf8d8 of volume 59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] snapshot_file for this snap is: volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d328315-c1c6-4b30-a2e9-1fb5494f3384]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:57 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.357s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:26:57 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] Deleted volume successfully. Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6c08c298-6de8-4905-a246-fdfebf76ed27 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-b531721a-fbc1-44bd-82ac-dc9fe9d89356-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:57 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8 Jul 14 21:26:57 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:57 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412" returned: 0 in 0.703s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:57 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412 Jul 14 21:26:57 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:57 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8" returned: 0 in 0.615s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:26:57 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.e9003f72-2760-406a-9eb8-b2aa7fc2c412" returned: 0 in 0.360s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:58 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb072ba-70bd-4ab7-b472-df51f09f3e6d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-quobyte-e9003f72-2760-406a-9eb8-b2aa7fc2c412" released by "_delete_snapshot" :: held 2.004s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-quobyte-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990" released by "delete_snapshot" :: held 2.051s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:58 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Created reservations ['36595d0e-7658-4c30-931a-e2a626257667', '21b4a067-260f-40de-ba55-a6062c8884b9', 'c7cb6945-24ed-4466-84cf-53a26e206a4b', '65df5af8-229e-4e50-b9cf-df08c5794d70'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:26:58 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 Jul 14 21:26:58 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:58 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Delete snapshot completed successfully. Jul 14 21:26:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6315912d-0596-4aa9-acba-8063e21e3b11 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-e9003f72-2760-406a-9eb8-b2aa7fc2c412-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:58 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05" returned: 0 in 0.423s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:58 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8 Jul 14 21:26:58 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:58 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8" returned: 0 in 0.473s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:58 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8 Jul 14 21:26:58 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Acquiring lock "cinder-88ff40b1-1f40-4b98-b333-84d4844d736a-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-88ff40b1-1f40-4b98-b333-84d4844d736a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Acquiring lock "cinder-quobyte-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-quobyte-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Acquiring lock "cinder-quobyte-88ff40b1-1f40-4b98-b333-84d4844d736a" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-quobyte-88ff40b1-1f40-4b98-b333-84d4844d736a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Deleting offline snapshot 88ff40b1-1f40-4b98-b333-84d4844d736a of volume f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:26:59 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] snapshot_file for this snap is: volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05.26c11b44-9234-423a-b9a1-88e762fbf8d8" returned: 0 in 0.435s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2887adfc-ddfe-47e8-b112-c233db137518]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-quobyte-26c11b44-9234-423a-b9a1-88e762fbf8d8" released by "_delete_snapshot" :: held 2.114s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-quobyte-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05" released by "delete_snapshot" :: held 2.160s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] Created reservations ['96e26ae2-f4bb-414b-be86-4df7197acd08', 'e59376f7-433f-4054-ae20-94dbdd23c984', '3465b766-c1c6-466b-910f-903366799b28', '029ac501-0dd0-4c2c-b5d8-98d3fd14e7bd'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:26:59 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a Jul 14 21:26:59 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:26:59 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] Delete snapshot completed successfully. Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-731c34c7-d93f-4693-93e9-7f83b9405a42 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-26c11b44-9234-423a-b9a1-88e762fbf8d8-delete_snapshot" released by "delete_snapshot" :: held 2.427s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:26:59 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a" returned: 0 in 0.512s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e84aa1-e3f0-4122-a028-32102fcdbe43]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:26:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:00 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a Jul 14 21:27:00 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:00 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a" returned: 0 in 0.426s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:27:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:00 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a Jul 14 21:27:00 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "cinder-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "cinder-quobyte-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-quobyte-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05" acquired by "delete_volume" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:00 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fa80a6-4dd3-45dd-a604-47a1498fc8cd]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:00 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 Jul 14 21:27:00 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:00 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a" returned: 0 in 0.554s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:00 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a Jul 14 21:27:00 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:01 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05" returned: 0 in 0.371s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:01 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05 Jul 14 21:27:01 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:01 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.88ff40b1-1f40-4b98-b333-84d4844d736a" returned: 0 in 0.279s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Acquiring lock "cinder-b9aaad94-1e6e-4010-8a82-27a3c5e8a106-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-quobyte-88ff40b1-1f40-4b98-b333-84d4844d736a" released by "_delete_snapshot" :: held 1.969s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-quobyte-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990" released by "delete_snapshot" :: held 1.996s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "cinder-b9aaad94-1e6e-4010-8a82-27a3c5e8a106-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Acquiring lock "cinder-quobyte-b9aaad94-1e6e-4010-8a82-27a3c5e8a106" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:01 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05" returned: 0 in 0.302s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-quobyte-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05" released by "delete_volume" :: held 0.759s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "cinder-quobyte-b9aaad94-1e6e-4010-8a82-27a3c5e8a106" acquired by "delete_volume" :: waited 0.028s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0689fcc8-15e6-4df6-a3f8-04525884217f]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Created reservations ['b0033eaa-39dd-4f4e-b674-c1b3aa75045c', 'ca78a704-3e9f-403b-b825-652df2751809', 'f6fb6731-63e9-4c22-8410-841b463b823e', 'f1faf6d5-5844-4fa9-9cd1-b0308131bc5a'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] Created reservations ['fe63323a-1d15-40be-8ed3-ffcd52968190', '2da05f1d-14a4-43c7-8183-1c38cfabf5e2', '2c9d5378-536b-49dc-9c4f-73370e03b9d4', 'b03e19ae-b977-4005-908d-f72a99661351'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:27:01 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Delete snapshot completed successfully. Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d40eb8bd-01fc-44a3-9c70-768f360f9142 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-88ff40b1-1f40-4b98-b333-84d4844d736a-delete_snapshot" released by "delete_snapshot" :: held 2.292s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:01 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106 Jul 14 21:27:01 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:01 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:27:01 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:01 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106" returned: 0 in 0.407s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:01 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.263s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:27:01 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] Deleted volume successfully. Jul 14 21:27:01 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106 Jul 14 21:27:01 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc70e028-e6ff-4949-9d7d-c45feb557950 tempest-CreateVolumesFromSnapshotTest-935989315 None] Lock "cinder-59bcb2e6-fead-4d92-9bc3-7a4de42f5b05-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:02 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-b9aaad94-1e6e-4010-8a82-27a3c5e8a106" returned: 0 in 0.260s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "cinder-quobyte-b9aaad94-1e6e-4010-8a82-27a3c5e8a106" released by "delete_volume" :: held 0.710s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Created reservations ['6b080b99-1314-43db-b2bf-23b11390cd02', '80a98018-6519-470e-a168-c80917077b0a', 'f97c21d1-66ed-4f54-a7d6-db15fdeb2d7f', 'f95efb2c-05d7-47d0-9325-8af04c0a820d'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:02 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:27:02 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Acquiring lock "cinder-61c83f50-4a6f-45a0-aa95-1832c5337cd5-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "cinder-61c83f50-4a6f-45a0-aa95-1832c5337cd5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] Acquiring lock "cinder-aa1597d9-c236-49c1-a2db-8052ff936c1a-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:02 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.376s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:27:02 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Deleted volume successfully. Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Acquiring lock "cinder-quobyte-61c83f50-4a6f-45a0-aa95-1832c5337cd5" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-aa1597d9-c236-49c1-a2db-8052ff936c1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] Acquiring lock "cinder-quobyte-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-11709dfa-b4e2-40fb-826f-c65c8d05babc tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "cinder-b9aaad94-1e6e-4010-8a82-27a3c5e8a106-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "cinder-quobyte-61c83f50-4a6f-45a0-aa95-1832c5337cd5" acquired by "delete_volume" :: waited 0.044s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-quobyte-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990" acquired by "delete_snapshot" :: waited 0.046s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] Acquiring lock "cinder-quobyte-aa1597d9-c236-49c1-a2db-8052ff936c1a" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-quobyte-aa1597d9-c236-49c1-a2db-8052ff936c1a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] Deleting offline snapshot aa1597d9-c236-49c1-a2db-8052ff936c1a of volume f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] snapshot_file for this snap is: volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ed8c1a-048f-49ca-87e2-2b6ebc7d3046]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77e937b-240f-4527-9899-5f3bcee5fe62]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:02 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5 Jul 14 21:27:02 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:02 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a Jul 14 21:27:02 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:03 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a" returned: 0 in 0.485s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:27:03 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5" returned: 0 in 0.538s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[116fa7f1-6310-44b1-824f-1d855737702a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:03 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5 Jul 14 21:27:03 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:03 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 Jul 14 21:27:03 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-b0089ded-6af7-45af-b7a6-334729a19af9 req-59710571-4152-45df-9e7c-012ab0b0d0b4 tempest-TestStampPattern-1434720668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-b0089ded-6af7-45af-b7a6-334729a19af9 req-59710571-4152-45df-9e7c-012ab0b0d0b4 tempest-TestStampPattern-1434720668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[887e6a12-f2ca-4d7f-89ec-34dd7982dda1]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-b0089ded-6af7-45af-b7a6-334729a19af9 req-59710571-4152-45df-9e7c-012ab0b0d0b4 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:03 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c Jul 14 21:27:03 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:03 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c83f50-4a6f-45a0-aa95-1832c5337cd5" returned: 0 in 0.390s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "cinder-quobyte-61c83f50-4a6f-45a0-aa95-1832c5337cd5" released by "delete_volume" :: held 1.016s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Created reservations ['8d928254-350d-403b-98ab-842a4fd790af', '665f58fc-6db9-443c-b25e-2f00ff41bde6', '8ad5220f-2ee1-4ac2-9dcc-ced18d1fbc20', '5616e8c8-b2cc-41b4-8c72-5b486591ea57'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:27:03 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990" returned: 0 in 0.489s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:03 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a Jul 14 21:27:03 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:03 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:27:03 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:03 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-b0089ded-6af7-45af-b7a6-334729a19af9 req-59710571-4152-45df-9e7c-012ab0b0d0b4 tempest-TestStampPattern-1434720668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c" returned: 0 in 0.460s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-b0089ded-6af7-45af-b7a6-334729a19af9 req-59710571-4152-45df-9e7c-012ab0b0d0b4 tempest-TestStampPattern-1434720668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.483s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-b0089ded-6af7-45af-b7a6-334729a19af9 req-59710571-4152-45df-9e7c-012ab0b0d0b4 tempest-TestStampPattern-1434720668 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68a3259b-4533-47c7-847e-c1509306bfa2', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:27:04 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-b0089ded-6af7-45af-b7a6-334729a19af9 req-59710571-4152-45df-9e7c-012ab0b0d0b4 tempest-TestStampPattern-1434720668 None] attachment_update completed successfully. Jul 14 21:27:04 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.311s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:04 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:27:04 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Deleted volume successfully. Jul 14 21:27:04 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-41bcb96a-be65-4be3-8eb8-9885c1850ee5 tempest-TestServerVolumeAttachmentScenario-2143123397 None] Lock "cinder-61c83f50-4a6f-45a0-aa95-1832c5337cd5-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:04 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a" returned: 0 in 0.448s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:04 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a Jul 14 21:27:04 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:04 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990.aa1597d9-c236-49c1-a2db-8052ff936c1a" returned: 0 in 0.316s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:04 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-quobyte-aa1597d9-c236-49c1-a2db-8052ff936c1a" released by "_delete_snapshot" :: held 1.893s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:04 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-quobyte-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990" released by "delete_snapshot" :: held 1.918s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:04 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] Created reservations ['31304c80-4545-4b43-a082-70a26a18c638', 'af869d76-8517-4eee-bd47-811182f7c487', 'd80f0e8a-be84-45de-9bdf-857ffaaa0ae4', 'bd759d07-c311-4ad2-acd8-daa740810bbf'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:27:04 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] Delete snapshot completed successfully. Jul 14 21:27:04 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4549da7c-147e-4915-a75b-1e502babf2b3 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-aa1597d9-c236-49c1-a2db-8052ff936c1a-delete_snapshot" released by "delete_snapshot" :: held 2.158s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] Acquiring lock "cinder-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] Acquiring lock "cinder-quobyte-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-quobyte-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:06 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cc10d8-b1f9-48d0-9282-3dcde369a367]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:06 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 Jul 14 21:27:06 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:06 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990" returned: 0 in 0.494s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:06 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990 Jul 14 21:27:06 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:06 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990" returned: 0 in 0.375s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-quobyte-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990" released by "delete_volume" :: held 0.929s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:07 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] Created reservations ['be223142-f0d8-48f8-89ec-3d95a23af386', 'a1d6c36b-314f-4231-bf9d-3ba4fd560def', 'c87793f0-7d35-4ec2-ad90-9d7ca4a2a718', '61f3d5b1-e23d-423b-b019-6bf422ba5ad5'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:27:07 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-f8c33eeb-1620-40f2-a17e-425b77e08417 req-67fc7a08-c6f0-48df-850b-322e3c215277 tempest-TestStampPattern-1434720668 None] Terminate volume connection completed successfully. Jul 14 21:27:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-f8c33eeb-1620-40f2-a17e-425b77e08417 req-67fc7a08-c6f0-48df-850b-322e3c215277 tempest-TestStampPattern-1434720668 None] Deleting attachment 68a3259b-4533-47c7-847e-c1509306bfa2. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:27:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:27:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:27:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:07 devstack sudo[103784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:27:07 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:07 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.309s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:07 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:27:07 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] Deleted volume successfully. Jul 14 21:27:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-375f4b30-79b4-4488-bda6-d386b726db46 tempest-VolumesSnapshotListTestJSON-1401366895 None] Lock "cinder-f4ce0ce8-ba9f-48a0-8c51-ca67a0385990-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] Acquiring lock "cinder-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] Lock "cinder-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] Acquiring lock "cinder-quobyte-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] Lock "cinder-quobyte-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c" acquired by "delete_volume" :: waited 0.029s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:12 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a2be5e-17c3-45e2-8f1c-d5edd4e3df07]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:13 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c Jul 14 21:27:13 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:13 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c" returned: 0 in 0.485s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:13 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c Jul 14 21:27:13 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:13 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c" returned: 0 in 0.361s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] Lock "cinder-quobyte-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c" released by "delete_volume" :: held 0.932s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:13 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] Created reservations ['8da8848b-07f0-4048-bb5a-e9166c6767f9', '3bb35ee4-406b-4348-8301-48d351049504', '76934aa3-d8fa-4861-8b18-de460aedd6de', '046ff597-d0ea-4258-b75c-240d9f77c50c'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:27:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:13 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:27:13 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:27:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:13 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:27:13 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:14 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.347s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:14 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:27:14 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] Deleted volume successfully. Jul 14 21:27:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-da375452-84bf-4c59-a3c2-e1a38ff1a9f9 tempest-TestStampPattern-1434720668 None] Lock "cinder-993b6277-bae0-4ddb-a0e0-5dfdea66ef0c-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] Acquiring lock "cinder-0f86f52f-6b47-4251-b6fb-8c8dc071b8c9-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] Lock "cinder-0f86f52f-6b47-4251-b6fb-8c8dc071b8c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] Acquiring lock "cinder-quobyte-93cb8dc4-9acf-4594-890c-b3c19755dd1a" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] Lock "cinder-quobyte-93cb8dc4-9acf-4594-890c-b3c19755dd1a" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] Acquiring lock "cinder-quobyte-0f86f52f-6b47-4251-b6fb-8c8dc071b8c9" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] Lock "cinder-quobyte-0f86f52f-6b47-4251-b6fb-8c8dc071b8c9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] Deleting offline snapshot 0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 of volume 93cb8dc4-9acf-4594-890c-b3c19755dd1a {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:27:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] snapshot_file for this snap is: volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:27:14 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c72caa5-c0c0-4c9a-9dc4-2f2dde2f084e]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:14 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 Jul 14 21:27:14 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:15 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9" returned: 0 in 0.484s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:27:15 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1575ded3-64d5-4164-a367-4ebd519289cd]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:15 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a Jul 14 21:27:15 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:15 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a" returned: 0 in 0.447s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:15 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 Jul 14 21:27:15 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:15 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9" returned: 0 in 0.381s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:16 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9 Jul 14 21:27:16 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:16 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a.0f86f52f-6b47-4251-b6fb-8c8dc071b8c9" returned: 0 in 0.283s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] Lock "cinder-quobyte-0f86f52f-6b47-4251-b6fb-8c8dc071b8c9" released by "_delete_snapshot" :: held 1.786s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] Lock "cinder-quobyte-93cb8dc4-9acf-4594-890c-b3c19755dd1a" released by "delete_snapshot" :: held 1.824s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:16 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] Created reservations ['bd2aa084-1d43-438c-ad97-6c209c80782a', '14152975-3438-4b31-b067-4800f0996c7c', '80aaa535-6195-46a7-a5d4-f91e022003d9', '2acb0331-1fc9-41d0-bef9-82f8bcbd2182'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:27:16 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] Delete snapshot completed successfully. Jul 14 21:27:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fdd6e77a-6c4c-43c6-8e34-6468723d9ee2 tempest-TestStampPattern-1434720668 None] Lock "cinder-0f86f52f-6b47-4251-b6fb-8c8dc071b8c9-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] Acquiring lock "cinder-93cb8dc4-9acf-4594-890c-b3c19755dd1a-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] Lock "cinder-93cb8dc4-9acf-4594-890c-b3c19755dd1a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] Acquiring lock "cinder-quobyte-93cb8dc4-9acf-4594-890c-b3c19755dd1a" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] Lock "cinder-quobyte-93cb8dc4-9acf-4594-890c-b3c19755dd1a" acquired by "delete_volume" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:21 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da4f573-23c4-4437-b7a3-923d1c2baf11]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:22 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a Jul 14 21:27:22 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:22 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a" returned: 0 in 0.448s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:22 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a Jul 14 21:27:22 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:22 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-93cb8dc4-9acf-4594-890c-b3c19755dd1a" returned: 0 in 0.281s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] Lock "cinder-quobyte-93cb8dc4-9acf-4594-890c-b3c19755dd1a" released by "delete_volume" :: held 0.810s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:22 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] Created reservations ['811f49d6-08e1-47e3-ad7b-d80f62239dd6', 'b157fcaa-d2f9-4582-996f-ba0a9f503533', 'e928ac8c-19e1-4960-8cc9-89427f4c9765', '2d1107e6-9407-44fd-b1da-01e06189c64a'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:27:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:27:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:27:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:22 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:27:22 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:23 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.271s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:23 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:27:23 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] Deleted volume successfully. Jul 14 21:27:23 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-59d25cb4-9e14-468e-8970-7a0b24879667 tempest-TestStampPattern-1434720668 None] Lock "cinder-93cb8dc4-9acf-4594-890c-b3c19755dd1a-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:32 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=119,cinder:UPDATE=158,cinder:DELETE=15,cinder:INSERT=40 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:27:32 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:UPDATE=154,cinder:SELECT=145,cinder:INSERT=37,cinder:DELETE=9 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:27:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:27:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:27:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:27:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:36 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:27:36 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:36 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.300s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:36 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:27:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:27:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 28 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:27:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Flow 'volume_create_manager' (811182cd-9150-4198-9ec6-fc7d88c44bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b5eab0-abf9-4abc-aaec-49e586632a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b5eab0-abf9-4abc-aaec-49e586632a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1071018419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32b0670-9a7d-4b73-98f3-81536422f39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b8788af7f84e8d91cd57da709e6145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:27:44Z,use_quota=True,user_id='42c402a43579465a87cc9f07ff7a2e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(076d4877-1cc2-4ee7-93df-37b5707242f8),volume_type_id=076d4877-1cc2-4ee7-93df-37b5707242f8)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438c4a62-4462-4010-b800-69a5f0a5c1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438c4a62-4462-4010-b800-69a5f0a5c1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43124c87-6c4f-4beb-8036-5a13974c231a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43124c87-6c4f-4beb-8036-5a13974c231a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a32b0670-9a7d-4b73-98f3-81536422f39c', 'volume_name': 'volume-a32b0670-9a7d-4b73-98f3-81536422f39c', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3472e7-4747-4575-baa8-be0aca0c7a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3472e7-4747-4575-baa8-be0aca0c7a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad5225b-8b3b-496f-a1bc-afcb126c05ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:43 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Volume a32b0670-9a7d-4b73-98f3-81536422f39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a32b0670-9a7d-4b73-98f3-81536422f39c', 'volume_size': 1} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1071018419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32b0670-9a7d-4b73-98f3-81536422f39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b8788af7f84e8d91cd57da709e6145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:27:44Z,use_quota=True,user_id='42c402a43579465a87cc9f07ff7a2e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(076d4877-1cc2-4ee7-93df-37b5707242f8),volume_type_id=076d4877-1cc2-4ee7-93df-37b5707242f8)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Creating volume a32b0670-9a7d-4b73-98f3-81536422f39c {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:27:43 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:27:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a32b0670-9a7d-4b73-98f3-81536422f39c 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:43 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a32b0670-9a7d-4b73-98f3-81536422f39c 1073741824 Jul 14 21:27:43 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:44 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:27:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Flow 'volume_create_manager' (eae60f3f-3adc-461b-9989-5e413f710b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:27:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f513aae-e4b9-427a-9a24-898bd524c299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f513aae-e4b9-427a-9a24-898bd524c299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-379230667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f7cecb-d9e2-4458-af82-7695e6d5d7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b8788af7f84e8d91cd57da709e6145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:27:44Z,use_quota=True,user_id='42c402a43579465a87cc9f07ff7a2e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4c67039-fa03-4145-a410-349bf81ef579),volume_type_id=e4c67039-fa03-4145-a410-349bf81ef579)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9602bb8a-cf4d-4ff1-85aa-cce565354a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9602bb8a-cf4d-4ff1-85aa-cce565354a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d66aaaf-dcf0-45e5-9542-ed60ad3ef2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d66aaaf-dcf0-45e5-9542-ed60ad3ef2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6f7cecb-d9e2-4458-af82-7695e6d5d7ad', 'volume_name': 'volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450cc9ea-bd2c-43dd-afa6-a8c786a72248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450cc9ea-bd2c-43dd-afa6-a8c786a72248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1795764e-6647-4167-bed4-2591e8d9402b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:44 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Volume d6f7cecb-d9e2-4458-af82-7695e6d5d7ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad', 'volume_size': 1} Jul 14 21:27:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:44 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a32b0670-9a7d-4b73-98f3-81536422f39c 1073741824" returned: 0 in 0.635s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a32b0670-9a7d-4b73-98f3-81536422f39c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:44 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a32b0670-9a7d-4b73-98f3-81536422f39c Jul 14 21:27:44 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:45 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a32b0670-9a7d-4b73-98f3-81536422f39c" returned: 0 in 0.482s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.692s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-379230667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f7cecb-d9e2-4458-af82-7695e6d5d7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b8788af7f84e8d91cd57da709e6145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:27:44Z,use_quota=True,user_id='42c402a43579465a87cc9f07ff7a2e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4c67039-fa03-4145-a410-349bf81ef579),volume_type_id=e4c67039-fa03-4145-a410-349bf81ef579)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Creating volume d6f7cecb-d9e2-4458-af82-7695e6d5d7ad {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:27:45 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad5225b-8b3b-496f-a1bc-afcb126c05ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a32b0670-9a7d-4b73-98f3-81536422f39c', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:45 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad 1073741824 Jul 14 21:27:45 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc8b0af-92c1-4faa-9a45-73da63544edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:45 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Volume volume-a32b0670-9a7d-4b73-98f3-81536422f39c (a32b0670-9a7d-4b73-98f3-81536422f39c): created successfully Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc8b0af-92c1-4faa-9a45-73da63544edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Flow 'volume_create_manager' (811182cd-9150-4198-9ec6-fc7d88c44bbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:27:45 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-cf7beaba-32aa-47ab-b77c-ea35b9f7d5dd tempest-TestInstancesWithCinderVolumes-297499416 None] Created volume successfully. Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Flow 'volume_create_manager' (2dc71bf0-c4cb-4940-868e-9a90d89c1729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a390e3-b711-402d-8264-c35f59b4d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a390e3-b711-402d-8264-c35f59b4d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-174339565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd37c945-c049-45c9-ab1e-42b4f7d8edf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b8788af7f84e8d91cd57da709e6145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:27:45Z,use_quota=True,user_id='42c402a43579465a87cc9f07ff7a2e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e8b984c-0396-4cbf-9153-078bd23e8472),volume_type_id=1e8b984c-0396-4cbf-9153-078bd23e8472)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989210f7-69e2-4789-b75a-6b68c011b8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989210f7-69e2-4789-b75a-6b68c011b8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6804b152-d27a-4475-8478-540331abfeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG cinder.image.glance [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Creating Keystone auth plugin from conf {{(pid=88300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 21:27:45 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad 1073741824" returned: 0 in 0.791s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:46 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6804b152-d27a-4475-8478-540331abfeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd37c945-c049-45c9-ab1e-42b4f7d8edf3', 'volume_name': 'volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3', 'volume_size': 1, 'image_id': '36728b57-af30-4fec-81a9-e1d1625cab53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36728b57-af30-4fec-81a9-e1d1625cab53', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1262987024', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4b8788af7f84e8d91cd57da709e6145', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36728b57-af30-4fec-81a9-e1d1625cab53', 'created_at': datetime.datetime(2026, 7, 14, 19, 27, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 27, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36728b57-af30-4fec-81a9-e1d1625cab53/file', 'properties': {}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:46 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36951a52-9169-412a-aa72-03c618c166d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:46 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36951a52-9169-412a-aa72-03c618c166d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:46 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa03772-3941-4f0d-a245-3ac7d229b10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:46 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Volume cd37c945-c049-45c9-ab1e-42b4f7d8edf3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3', 'volume_size': 1, 'image_id': '36728b57-af30-4fec-81a9-e1d1625cab53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36728b57-af30-4fec-81a9-e1d1625cab53', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1262987024', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4b8788af7f84e8d91cd57da709e6145', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36728b57-af30-4fec-81a9-e1d1625cab53', 'created_at': datetime.datetime(2026, 7, 14, 19, 27, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 27, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36728b57-af30-4fec-81a9-e1d1625cab53/file', 'properties': {}}, 'image_service': } Jul 14 21:27:46 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Trying to clone cd37c945-c049-45c9-ab1e-42b4f7d8edf3 from image 36728b57-af30-4fec-81a9-e1d1625cab53 at location (None, [{'url': 'file:///opt/stack/data/glance/images/36728b57-af30-4fec-81a9-e1d1625cab53', 'metadata': {}}]). {{(pid=88300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 21:27:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:46 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad Jul 14 21:27:46 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:46 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad" returned: 0 in 0.382s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:46 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:27:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:46 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1795764e-6647-4167-bed4-2591e8d9402b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:46 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1eb7ad6-05c5-4c1e-877e-1ea5ebc5a645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:46 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Volume volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad (d6f7cecb-d9e2-4458-af82-7695e6d5d7ad): created successfully Jul 14 21:27:46 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1eb7ad6-05c5-4c1e-877e-1ea5ebc5a645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:46 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Flow 'volume_create_manager' (eae60f3f-3adc-461b-9989-5e413f710b19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:27:46 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-350ad551-9192-4771-a964-773a3601d8f3 tempest-TestInstancesWithCinderVolumes-297499416 None] Created volume successfully. Jul 14 21:27:49 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36728b57-af30-4fec-81a9-e1d1625cab53_mcxq8qvqdevstack@QuobyteHD, size 20.69 MB, duration 3.93 sec {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 21:27:49 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Image download 20.69 MB at 5.26 MB/s Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcdd8e7-c7b9-4241-94fc-310cdff64c3c]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36728b57-af30-4fec-81a9-e1d1625cab53_mcxq8qvqdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Flow 'volume_create_manager' (f49de429-0167-47b4-86a2-8e70729c1b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b48300-e601-4b07-bc77-58993db0ffd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b48300-e601-4b07-bc77-58993db0ffd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3678d78-f881-41dc-81b0-df797251b806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952ec75f09904da09e9ea58dee4b0da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:27:50Z,use_quota=True,user_id='84eb688fd75f40b1bbb638d7b3eb02d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:50 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36728b57-af30-4fec-81a9-e1d1625cab53_mcxq8qvqdevstack@QuobyteHD Jul 14 21:27:50 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbbbfe26-f2f7-43c5-b812-1fdce39e18fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbbbfe26-f2f7-43c5-b812-1fdce39e18fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b97a3e3-df4b-4548-b3cb-351f498645d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.image.glance [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Creating Keystone auth plugin from conf {{(pid=88300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 21:27:50 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36728b57-af30-4fec-81a9-e1d1625cab53_mcxq8qvqdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Temporary image 36728b57-af30-4fec-81a9-e1d1625cab53 is fetched for user 42c402a43579465a87cc9f07ff7a2e4f. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[44200f1b-af09-4b0f-a51a-caf2486e7517]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36728b57-af30-4fec-81a9-e1d1625cab53_mcxq8qvqdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b97a3e3-df4b-4548-b3cb-351f498645d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c3678d78-f881-41dc-81b0-df797251b806', 'volume_name': 'volume-c3678d78-f881-41dc-81b0-df797251b806', 'volume_size': 1, 'image_id': '80f34403-a27f-4b14-832c-2b21bec6a1d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80f34403-a27f-4b14-832c-2b21bec6a1d5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '430bedc9b9cc007b2072bca727f83cb0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '952ec75f09904da09e9ea58dee4b0da7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff969345c2ca8aa87aab43b3ba49bb89c5ae940379bbd9bfc616af51f68132075ab0a4c13cbf7c0d8d7021b694c1516e7424bd4d424f12e61029d0ab86e408d4', 'id': '80f34403-a27f-4b14-832c-2b21bec6a1d5', 'created_at': datetime.datetime(2026, 7, 14, 19, 27, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 27, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80f34403-a27f-4b14-832c-2b21bec6a1d5/file', 'properties': {}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f594d4a-a953-486c-b5ed-fbf0e2d5e519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f594d4a-a953-486c-b5ed-fbf0e2d5e519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443ff38b-3a4b-4b6f-9ee2-03282445b74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:50 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Volume c3678d78-f881-41dc-81b0-df797251b806: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c3678d78-f881-41dc-81b0-df797251b806', 'volume_size': 1, 'image_id': '80f34403-a27f-4b14-832c-2b21bec6a1d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80f34403-a27f-4b14-832c-2b21bec6a1d5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '430bedc9b9cc007b2072bca727f83cb0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '952ec75f09904da09e9ea58dee4b0da7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff969345c2ca8aa87aab43b3ba49bb89c5ae940379bbd9bfc616af51f68132075ab0a4c13cbf7c0d8d7021b694c1516e7424bd4d424f12e61029d0ab86e408d4', 'id': '80f34403-a27f-4b14-832c-2b21bec6a1d5', 'created_at': datetime.datetime(2026, 7, 14, 19, 27, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 27, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80f34403-a27f-4b14-832c-2b21bec6a1d5/file', 'properties': {}}, 'image_service': } Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Trying to clone c3678d78-f881-41dc-81b0-df797251b806 from image 80f34403-a27f-4b14-832c-2b21bec6a1d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/80f34403-a27f-4b14-832c-2b21bec6a1d5', 'metadata': {}}]). {{(pid=88300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 21:27:50 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36728b57-af30-4fec-81a9-e1d1625cab53_mcxq8qvqdevstack@QuobyteHD Jul 14 21:27:50 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 21:27:50 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Image download 0.00 MB at 0.00 MB/s Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[35de6458-0ef6-498b-8617-60842650c2ed]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:50 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36728b57-af30-4fec-81a9-e1d1625cab53_mcxq8qvqdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-174339565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd37c945-c049-45c9-ab1e-42b4f7d8edf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b8788af7f84e8d91cd57da709e6145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:27:45Z,use_quota=True,user_id='42c402a43579465a87cc9f07ff7a2e4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e8b984c-0396-4cbf-9153-078bd23e8472),volume_type_id=1e8b984c-0396-4cbf-9153-078bd23e8472)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Creating volume cd37c945-c049-45c9-ab1e-42b4f7d8edf3 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:27:50 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:27:50 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:27:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:50 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:50 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 1073741824 Jul 14 21:27:50 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:51 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:51 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD Jul 14 21:27:51 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:51 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 1073741824" returned: 0 in 0.496s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:51 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 Jul 14 21:27:51 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:51 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD" returned: 1 in 0.391s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:27:51 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Temporary image 80f34403-a27f-4b14-832c-2b21bec6a1d5 is fetched for user 84eb688fd75f40b1bbb638d7b3eb02d7. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 21:27:51 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf658b3-8b16-446e-ae98-9a9fde7d6d1f]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:51 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3" returned: 0 in 0.276s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:27:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:51 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Attempting download of 36728b57-af30-4fec-81a9-e1d1625cab53 ((None, [{'url': 'file:///opt/stack/data/glance/images/36728b57-af30-4fec-81a9-e1d1625cab53', 'metadata': {}}])) to volume cd37c945-c049-45c9-ab1e-42b4f7d8edf3. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 21:27:51 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD Jul 14 21:27:51 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:51 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c036f1-8a82-4664-823d-79257afbc4f5]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36728b57-af30-4fec-81a9-e1d1625cab53_22ze7mif {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:51 devstack sudo[103994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36728b57-af30-4fec-81a9-e1d1625cab53_22ze7mif Jul 14 21:27:51 devstack sudo[103994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:52 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:52 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD Jul 14 21:27:52 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:52 devstack sudo[103994]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36728b57-af30-4fec-81a9-e1d1625cab53_22ze7mif" returned: 0 in 0.333s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36728b57-af30-4fec-81a9-e1d1625cab53_22ze7mif {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:52 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36728b57-af30-4fec-81a9-e1d1625cab53_22ze7mif Jul 14 21:27:52 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:52 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3678d78-f881-41dc-81b0-df797251b806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='952ec75f09904da09e9ea58dee4b0da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:27:50Z,use_quota=True,user_id='84eb688fd75f40b1bbb638d7b3eb02d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Creating volume c3678d78-f881-41dc-81b0-df797251b806 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:27:52 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:52 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 1073741824 Jul 14 21:27:52 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Flow 'volume_create_manager' (b91b9443-e38a-46a1-9942-726424f2be4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:27:52 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27814510-d1b7-425f-9c6c-65d56b73a566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36728b57-af30-4fec-81a9-e1d1625cab53_22ze7mif" returned: 1 in 0.360s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36728b57-af30-4fec-81a9-e1d1625cab53_22ze7mif' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a93b6c9-15f0-4e02-b9d3-f63b915c82ab]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36728b57-af30-4fec-81a9-e1d1625cab53_mcxq8qvqdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27814510-d1b7-425f-9c6c-65d56b73a566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-563340941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f062281a-03b9-41d2-af02-bfe533e82d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f358310cc1e0422381f006659e774cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:27:52Z,use_quota=True,user_id='43b4153b01644c19968d97b0eef861f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83dc8cf0-d542-4330-8684-247764c8d328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83dc8cf0-d542-4330-8684-247764c8d328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4e2c53-4161-49b4-b75b-68f61e368a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.image.glance [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Creating Keystone auth plugin from conf {{(pid=88300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 21:27:52 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36728b57-af30-4fec-81a9-e1d1625cab53_mcxq8qvqdevstack@QuobyteHD Jul 14 21:27:52 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4e2c53-4161-49b4-b75b-68f61e368a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f062281a-03b9-41d2-af02-bfe533e82d81', 'volume_name': 'volume-f062281a-03b9-41d2-af02-bfe533e82d81', 'volume_size': 1, 'image_id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31d13bd45fbb466f90c2faf198257b79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'created_at': datetime.datetime(2026, 7, 14, 19, 8, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 8, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd120085-f7d4-4ac5-a56f-0dd47787c29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd120085-f7d4-4ac5-a56f-0dd47787c29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74cc2b5-c468-43d6-823b-31af53f08d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:52 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Volume f062281a-03b9-41d2-af02-bfe533e82d81: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f062281a-03b9-41d2-af02-bfe533e82d81', 'volume_size': 1, 'image_id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31d13bd45fbb466f90c2faf198257b79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'created_at': datetime.datetime(2026, 7, 14, 19, 8, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 8, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Trying to clone f062281a-03b9-41d2-af02-bfe533e82d81 from image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}]). {{(pid=88300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 21:27:52 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36728b57-af30-4fec-81a9-e1d1625cab53_mcxq8qvqdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] 36728b57-af30-4fec-81a9-e1d1625cab53 was qcow2, converting to raw {{(pid=88300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36728b57-af30-4fec-81a9-e1d1625cab53_mcxq8qvqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:52 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36728b57-af30-4fec-81a9-e1d1625cab53_mcxq8qvqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 Jul 14 21:27:52 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:52 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 1073741824" returned: 0 in 0.527s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:53 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 Jul 14 21:27:53 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:53 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_2z89lb8fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 21:27:53 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Image download 20.69 MB at 20.69 MB/s Jul 14 21:27:53 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a841ba-95ce-45c1-abef-47ab295835c3]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_2z89lb8fdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:53 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806" returned: 0 in 0.347s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:27:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:53 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Attempting download of 80f34403-a27f-4b14-832c-2b21bec6a1d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/80f34403-a27f-4b14-832c-2b21bec6a1d5', 'metadata': {}}])) to volume c3678d78-f881-41dc-81b0-df797251b806. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 21:27:53 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_2z89lb8fdevstack@QuobyteHD Jul 14 21:27:53 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:53 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc94bfa-72ba-45bb-9882-62ede0cba926]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80f34403-a27f-4b14-832c-2b21bec6a1d5_y7438_u1 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:53 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80f34403-a27f-4b14-832c-2b21bec6a1d5_y7438_u1 Jul 14 21:27:53 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:53 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_2z89lb8fdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:53 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Temporary image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 is fetched for user 43b4153b01644c19968d97b0eef861f2. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 21:27:53 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a44feb-8e96-4d6d-970b-61914ce6b28d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_2z89lb8fdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:53 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80f34403-a27f-4b14-832c-2b21bec6a1d5_y7438_u1" returned: 0 in 0.369s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80f34403-a27f-4b14-832c-2b21bec6a1d5_y7438_u1 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:53 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_2z89lb8fdevstack@QuobyteHD Jul 14 21:27:53 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:53 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80f34403-a27f-4b14-832c-2b21bec6a1d5_y7438_u1 Jul 14 21:27:53 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:54 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_2z89lb8fdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-563340941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f062281a-03b9-41d2-af02-bfe533e82d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f358310cc1e0422381f006659e774cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:27:52Z,use_quota=True,user_id='43b4153b01644c19968d97b0eef861f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Creating volume f062281a-03b9-41d2-af02-bfe533e82d81 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:27:54 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:54 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 1073741824 Jul 14 21:27:54 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:54 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80f34403-a27f-4b14-832c-2b21bec6a1d5_y7438_u1" returned: 1 in 0.455s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80f34403-a27f-4b14-832c-2b21bec6a1d5_y7438_u1' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb27af63-a2e7-4627-87a5-72bd240c606c]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:54 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD Jul 14 21:27:54 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:54 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36728b57-af30-4fec-81a9-e1d1625cab53_mcxq8qvqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3" returned: 0 in 1.620s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36728b57-af30-4fec-81a9-e1d1625cab53_mcxq8qvqdevstack@QuobyteHD, size 112.00 MB, duration 1.62 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:27:54 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Converted 112.00 MB image at 69.07 MB/s Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:54 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 1G Jul 14 21:27:54 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:54 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:54 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 1073741824" returned: 0 in 0.521s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:54 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 Jul 14 21:27:54 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:54 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD Jul 14 21:27:54 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:54 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 1G" returned: 0 in 0.326s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bae9da0-e2cd-4358-a3e1-c549b19551bb]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:54 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81" returned: 0 in 0.259s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Attempting download of 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}])) to volume f062281a-03b9-41d2-af02-bfe533e82d81. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 21:27:54 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] 80f34403-a27f-4b14-832c-2b21bec6a1d5 was raw, converting to raw {{(pid=88300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 21:27:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:54 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 Jul 14 21:27:54 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:54 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 Jul 14 21:27:54 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d93d95-c25b-4be7-b7bb-327f2454fbe0]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_be0o8o2d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:55 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_be0o8o2d Jul 14 21:27:55 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:55 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3" returned: 0 in 0.368s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:55 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806" returned: 0 in 0.355s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_80f34403-a27f-4b14-832c-2b21bec6a1d5_a7g522rxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:27:55 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Converted 0.00 MB image at 0.00 MB/s Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:55 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 1G Jul 14 21:27:55 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:55 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_be0o8o2d" returned: 0 in 0.352s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_be0o8o2d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:55 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 Jul 14 21:27:55 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:55 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_be0o8o2d Jul 14 21:27:55 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:55 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3" returned: 1 in 0.412s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Downloaded image 36728b57-af30-4fec-81a9-e1d1625cab53 ((None, [{'url': 'file:///opt/stack/data/glance/images/36728b57-af30-4fec-81a9-e1d1625cab53', 'metadata': {}}])) to volume cd37c945-c049-45c9-ab1e-42b4f7d8edf3 successfully. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 21:27:55 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Temporary image 36728b57-af30-4fec-81a9-e1d1625cab53 for user 42c402a43579465a87cc9f07ff7a2e4f is deleted. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Marking volume cd37c945-c049-45c9-ab1e-42b4f7d8edf3 as bootable. {{(pid=88300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 1G" returned: 0 in 0.346s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Copying metadata from image 36728b57-af30-4fec-81a9-e1d1625cab53 to cd37c945-c049-45c9-ab1e-42b4f7d8edf3. {{(pid=88300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Creating volume glance metadata for volume cd37c945-c049-45c9-ab1e-42b4f7d8edf3 backed by image 36728b57-af30-4fec-81a9-e1d1625cab53 with: {'image_id': '36728b57-af30-4fec-81a9-e1d1625cab53', 'image_name': 'tempest-scenario-img--1262987024', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c6808c-0bce-4717-ba40-0f54b49051ad]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa03772-3941-4f0d-a245-3ac7d229b10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3', 'volume_size': 1, 'image_id': '36728b57-af30-4fec-81a9-e1d1625cab53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36728b57-af30-4fec-81a9-e1d1625cab53', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1262987024', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4b8788af7f84e8d91cd57da709e6145', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36728b57-af30-4fec-81a9-e1d1625cab53', 'created_at': datetime.datetime(2026, 7, 14, 19, 27, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 27, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36728b57-af30-4fec-81a9-e1d1625cab53/file', 'properties': {}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:55 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12581055-2e33-4c83-9c92-a4fd8da6e7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_be0o8o2d" returned: 1 in 0.412s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_be0o8o2d' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aebb5b8-504a-409c-b9ca-1faf8989fad1]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_2z89lb8fdevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:55 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Volume volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 (cd37c945-c049-45c9-ab1e-42b4f7d8edf3): created successfully Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12581055-2e33-4c83-9c92-a4fd8da6e7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Flow 'volume_create_manager' (2dc71bf0-c4cb-4940-868e-9a90d89c1729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:27:55 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-6a18e711-1b67-4c12-8abb-16a0deb8d6c9 tempest-TestInstancesWithCinderVolumes-297499416 None] Created volume successfully. Jul 14 21:27:55 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 Jul 14 21:27:55 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:55 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_2z89lb8fdevstack@QuobyteHD Jul 14 21:27:55 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:56 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806" returned: 0 in 0.402s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:56 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_2z89lb8fdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:56 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 was qcow2, converting to raw {{(pid=88300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 21:27:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_2z89lb8fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:56 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_2z89lb8fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 Jul 14 21:27:56 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:56 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 Jul 14 21:27:56 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:56 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806" returned: 1 in 0.368s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:27:56 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Downloaded image 80f34403-a27f-4b14-832c-2b21bec6a1d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/80f34403-a27f-4b14-832c-2b21bec6a1d5', 'metadata': {}}])) to volume c3678d78-f881-41dc-81b0-df797251b806 successfully. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 21:27:56 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Temporary image 80f34403-a27f-4b14-832c-2b21bec6a1d5 for user 84eb688fd75f40b1bbb638d7b3eb02d7 is deleted. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 21:27:56 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Marking volume c3678d78-f881-41dc-81b0-df797251b806 as bootable. {{(pid=88300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 21:27:56 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Copying metadata from image 80f34403-a27f-4b14-832c-2b21bec6a1d5 to c3678d78-f881-41dc-81b0-df797251b806. {{(pid=88300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 21:27:56 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Creating volume glance metadata for volume c3678d78-f881-41dc-81b0-df797251b806 backed by image 80f34403-a27f-4b14-832c-2b21bec6a1d5 with: {'image_id': '80f34403-a27f-4b14-832c-2b21bec6a1d5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '430bedc9b9cc007b2072bca727f83cb0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 21:27:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443ff38b-3a4b-4b6f-9ee2-03282445b74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3678d78-f881-41dc-81b0-df797251b806', 'volume_size': 1, 'image_id': '80f34403-a27f-4b14-832c-2b21bec6a1d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80f34403-a27f-4b14-832c-2b21bec6a1d5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '430bedc9b9cc007b2072bca727f83cb0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '952ec75f09904da09e9ea58dee4b0da7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff969345c2ca8aa87aab43b3ba49bb89c5ae940379bbd9bfc616af51f68132075ab0a4c13cbf7c0d8d7021b694c1516e7424bd4d424f12e61029d0ab86e408d4', 'id': '80f34403-a27f-4b14-832c-2b21bec6a1d5', 'created_at': datetime.datetime(2026, 7, 14, 19, 27, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 27, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80f34403-a27f-4b14-832c-2b21bec6a1d5/file', 'properties': {}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb5085f-9918-4afa-a7c9-51bffd879bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:56 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Volume volume-c3678d78-f881-41dc-81b0-df797251b806 (c3678d78-f881-41dc-81b0-df797251b806): created successfully Jul 14 21:27:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb5085f-9918-4afa-a7c9-51bffd879bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Flow 'volume_create_manager' (f49de429-0167-47b4-86a2-8e70729c1b14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:27:56 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-17376eec-c7bf-4444-be92-6dc5a2bd1d31 tempest-VolumeImageDependencyTests-1217692985 None] Created volume successfully. Jul 14 21:27:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Acquiring lock "cinder-c3678d78-f881-41dc-81b0-df797251b806-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Lock "cinder-c3678d78-f881-41dc-81b0-df797251b806-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Acquiring lock "cinder-quobyte-c3678d78-f881-41dc-81b0-df797251b806" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:27:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Lock "cinder-quobyte-c3678d78-f881-41dc-81b0-df797251b806" acquired by "delete_volume" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:27:57 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d62c20-d2ca-4734-b44a-fb9332c23cdf]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:57 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 Jul 14 21:27:57 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:57 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_2z89lb8fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81" returned: 0 in 1.785s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:57 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_88be24f2-f1f9-490b-bc7d-d9ecbba697d4_2z89lb8fdevstack@QuobyteHD, size 112.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:27:57 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Converted 112.00 MB image at 62.68 MB/s Jul 14 21:27:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:57 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 1G Jul 14 21:27:57 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:58 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806" returned: 0 in 0.421s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:58 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 1G" returned: 0 in 0.416s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:58 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 Jul 14 21:27:58 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:58 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[08094a5e-a8bd-4647-99d9-5be62a61dc4e]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:58 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 Jul 14 21:27:58 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:58 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806" returned: 1 in 0.504s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:27:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:58 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806 Jul 14 21:27:58 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-b36c7be1-f5dd-4395-9967-d26d90b7f4bd req-c53250be-8e18-4602-bc5a-7ba3c708331c tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-b36c7be1-f5dd-4395-9967-d26d90b7f4bd req-c53250be-8e18-4602-bc5a-7ba3c708331c tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:58 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[400938e6-4638-411c-bc70-081a253c6ead]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:27:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-b36c7be1-f5dd-4395-9967-d26d90b7f4bd req-c53250be-8e18-4602-bc5a-7ba3c708331c tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:58 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81" returned: 0 in 0.473s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:58 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 Jul 14 21:27:58 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:59 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 Jul 14 21:27:59 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:59 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c3678d78-f881-41dc-81b0-df797251b806" returned: 0 in 0.311s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Lock "cinder-quobyte-c3678d78-f881-41dc-81b0-df797251b806" released by "delete_volume" :: held 1.321s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Created reservations ['1aa1b815-2570-479a-980b-be1f9435d3c1', '3003d772-44c2-4454-887e-42e64074676c', '14ff7e6c-e817-46fc-aea4-cc43ffbd4a0f', '35e028b8-2f3a-4d94-83d1-715e51f103d5'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:59 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81" returned: 1 in 0.483s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Downloaded image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}])) to volume f062281a-03b9-41d2-af02-bfe533e82d81 successfully. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Temporary image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 for user 43b4153b01644c19968d97b0eef861f2 is deleted. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Marking volume f062281a-03b9-41d2-af02-bfe533e82d81 as bootable. {{(pid=88300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 21:27:59 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:27:59 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:59 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-b36c7be1-f5dd-4395-9967-d26d90b7f4bd req-c53250be-8e18-4602-bc5a-7ba3c708331c tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3" returned: 0 in 0.562s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-b36c7be1-f5dd-4395-9967-d26d90b7f4bd req-c53250be-8e18-4602-bc5a-7ba3c708331c tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Copying metadata from image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 to f062281a-03b9-41d2-af02-bfe533e82d81. {{(pid=88300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Creating volume glance metadata for volume f062281a-03b9-41d2-af02-bfe533e82d81 backed by image 88be24f2-f1f9-490b-bc7d-d9ecbba697d4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74cc2b5-c468-43d6-823b-31af53f08d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f062281a-03b9-41d2-af02-bfe533e82d81', 'volume_size': 1, 'image_id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31d13bd45fbb466f90c2faf198257b79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '88be24f2-f1f9-490b-bc7d-d9ecbba697d4', 'created_at': datetime.datetime(2026, 7, 14, 19, 8, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 8, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88be24f2-f1f9-490b-bc7d-d9ecbba697d4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:59 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad2c69c8-2eae-4ac6-a8a2-6139c358774b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:27:59 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:27:59 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Volume volume-f062281a-03b9-41d2-af02-bfe533e82d81 (f062281a-03b9-41d2-af02-bfe533e82d81): created successfully Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad2c69c8-2eae-4ac6-a8a2-6139c358774b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Flow 'volume_create_manager' (b91b9443-e38a-46a1-9942-726424f2be4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:27:59 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a2f2b730-0d52-427a-bb4e-5d53a0892112 tempest-TestShelveInstance-1861996334 None] Created volume successfully. Jul 14 21:27:59 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.361s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:27:59 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Deleted volume successfully. Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-22e89df2-630a-4794-85b3-9231d7342a0a tempest-VolumeImageDependencyTests-1217692985 None] Lock "cinder-c3678d78-f881-41dc-81b0-df797251b806-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:27:59 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-b36c7be1-f5dd-4395-9967-d26d90b7f4bd req-c53250be-8e18-4602-bc5a-7ba3c708331c tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3" returned: 1 in 0.497s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-b36c7be1-f5dd-4395-9967-d26d90b7f4bd req-c53250be-8e18-4602-bc5a-7ba3c708331c tempest-TestInstancesWithCinderVolumes-297499416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-b36c7be1-f5dd-4395-9967-d26d90b7f4bd req-c53250be-8e18-4602-bc5a-7ba3c708331c tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.122s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:27:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-b36c7be1-f5dd-4395-9967-d26d90b7f4bd req-c53250be-8e18-4602-bc5a-7ba3c708331c tempest-TestInstancesWithCinderVolumes-297499416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb8c9ddb-77cc-4894-894e-dd2a199ca4db', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:28:00 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-b36c7be1-f5dd-4395-9967-d26d90b7f4bd req-c53250be-8e18-4602-bc5a-7ba3c708331c tempest-TestInstancesWithCinderVolumes-297499416 None] attachment_update completed successfully. Jul 14 21:28:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-dd5c1d8f-5f4e-4de1-a15f-bf07c72667b5 req-19e79251-dac0-4f68-b615-188dc25d16ed tempest-TestShelveInstance-1861996334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-dd5c1d8f-5f4e-4de1-a15f-bf07c72667b5 req-19e79251-dac0-4f68-b615-188dc25d16ed tempest-TestShelveInstance-1861996334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:04 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[39eb8600-2ced-46fd-9b72-3f945cce1ea9]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:28:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-dd5c1d8f-5f4e-4de1-a15f-bf07c72667b5 req-19e79251-dac0-4f68-b615-188dc25d16ed tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:04 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 Jul 14 21:28:04 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:05 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-dd5c1d8f-5f4e-4de1-a15f-bf07c72667b5 req-19e79251-dac0-4f68-b615-188dc25d16ed tempest-TestShelveInstance-1861996334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81" returned: 0 in 0.629s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-dd5c1d8f-5f4e-4de1-a15f-bf07c72667b5 req-19e79251-dac0-4f68-b615-188dc25d16ed tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:05 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 Jul 14 21:28:05 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:05 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-dd5c1d8f-5f4e-4de1-a15f-bf07c72667b5 req-19e79251-dac0-4f68-b615-188dc25d16ed tempest-TestShelveInstance-1861996334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81" returned: 1 in 0.796s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-dd5c1d8f-5f4e-4de1-a15f-bf07c72667b5 req-19e79251-dac0-4f68-b615-188dc25d16ed tempest-TestShelveInstance-1861996334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:28:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-dd5c1d8f-5f4e-4de1-a15f-bf07c72667b5 req-19e79251-dac0-4f68-b615-188dc25d16ed tempest-TestShelveInstance-1861996334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.507s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:06 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-dd5c1d8f-5f4e-4de1-a15f-bf07c72667b5 req-19e79251-dac0-4f68-b615-188dc25d16ed tempest-TestShelveInstance-1861996334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-f062281a-03b9-41d2-af02-bfe533e82d81', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93c7d236-7606-498c-b747-d86cb6f46e55', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:28:06 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-dd5c1d8f-5f4e-4de1-a15f-bf07c72667b5 req-19e79251-dac0-4f68-b615-188dc25d16ed tempest-TestShelveInstance-1861996334 None] attachment_update completed successfully. Jul 14 21:28:16 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:UPDATE=38,cinder:SELECT=39,cinder:INSERT=20,cinder:DELETE=1 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:28:16 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=50,cinder:UPDATE=23,cinder:INSERT=20,cinder:DELETE=5 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:28:16 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Flow 'volume_create_manager' (0464dba0-f648-4390-b479-4ef97d22a48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211cbaa0-0602-46df-ae7a-8c6d92caaceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211cbaa0-0602-46df-ae7a-8c6d92caaceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65952172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8ab003-7970-4074-bfce-481f89b2d15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0750a4e196d34ef7957a52e023465ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:28:17Z,use_quota=True,user_id='525210c7437a432cb8a88fe426c879fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1aaec60-33c8-4291-9850-962021ed4943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1aaec60-33c8-4291-9850-962021ed4943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9572eef4-08e5-49f3-b096-85e8410cc479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9572eef4-08e5-49f3-b096-85e8410cc479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b8ab003-7970-4074-bfce-481f89b2d15e', 'volume_name': 'volume-8b8ab003-7970-4074-bfce-481f89b2d15e', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe709f87-87f5-492c-972e-971fa1f506bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe709f87-87f5-492c-972e-971fa1f506bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458e1e6d-0d4f-48a0-aa4d-97fbcd174d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:17 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Volume 8b8ab003-7970-4074-bfce-481f89b2d15e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b8ab003-7970-4074-bfce-481f89b2d15e', 'volume_size': 1} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65952172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8ab003-7970-4074-bfce-481f89b2d15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0750a4e196d34ef7957a52e023465ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:28:17Z,use_quota=True,user_id='525210c7437a432cb8a88fe426c879fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Creating volume 8b8ab003-7970-4074-bfce-481f89b2d15e {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:28:17 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:28:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8b8ab003-7970-4074-bfce-481f89b2d15e 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:17 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8b8ab003-7970-4074-bfce-481f89b2d15e 1073741824 Jul 14 21:28:17 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:18 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8b8ab003-7970-4074-bfce-481f89b2d15e 1073741824" returned: 0 in 0.851s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8b8ab003-7970-4074-bfce-481f89b2d15e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:18 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8b8ab003-7970-4074-bfce-481f89b2d15e Jul 14 21:28:18 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:18 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8b8ab003-7970-4074-bfce-481f89b2d15e" returned: 0 in 0.624s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:28:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458e1e6d-0d4f-48a0-aa4d-97fbcd174d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b8ab003-7970-4074-bfce-481f89b2d15e', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e81e35-fbc6-4f9a-a5b0-7b6f5473c665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:18 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Volume volume-8b8ab003-7970-4074-bfce-481f89b2d15e (8b8ab003-7970-4074-bfce-481f89b2d15e): created successfully Jul 14 21:28:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e81e35-fbc6-4f9a-a5b0-7b6f5473c665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:18 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Flow 'volume_create_manager' (0464dba0-f648-4390-b479-4ef97d22a48e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:28:18 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a00b58ab-47c7-4401-899f-7e77dc8bdfe1 tempest-ProjectReaderTests-314056552 None] Created volume successfully. Jul 14 21:28:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] Acquiring lock "cinder-8b8ab003-7970-4074-bfce-481f89b2d15e-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:28:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] Lock "cinder-8b8ab003-7970-4074-bfce-481f89b2d15e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:28:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] Acquiring lock "cinder-quobyte-8b8ab003-7970-4074-bfce-481f89b2d15e" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:28:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] Lock "cinder-quobyte-8b8ab003-7970-4074-bfce-481f89b2d15e" acquired by "delete_volume" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:28:19 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[14654181-769e-4806-ae23-26394fc17be7]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:28:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8b8ab003-7970-4074-bfce-481f89b2d15e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:19 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8b8ab003-7970-4074-bfce-481f89b2d15e Jul 14 21:28:19 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:19 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8b8ab003-7970-4074-bfce-481f89b2d15e" returned: 0 in 0.469s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8b8ab003-7970-4074-bfce-481f89b2d15e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:20 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8b8ab003-7970-4074-bfce-481f89b2d15e Jul 14 21:28:20 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:20 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8b8ab003-7970-4074-bfce-481f89b2d15e" returned: 0 in 0.262s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] Lock "cinder-quobyte-8b8ab003-7970-4074-bfce-481f89b2d15e" released by "delete_volume" :: held 0.807s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:28:20 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] Created reservations ['3cae4f7f-9488-412e-8b50-690ef0646d69', '87dcb78b-41c5-4059-8bcd-2db6e02edf87', '4895150a-d697-47b8-9b37-b1582ddaee39', '9a7cceb8-791d-447d-8940-24f390c9fe9b'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:28:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:28:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:28:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:20 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:28:20 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:20 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.311s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:20 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:28:20 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] Deleted volume successfully. Jul 14 21:28:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0d26d69a-bd0e-483f-bdac-9b751bfd3237 tempest-ProjectReaderTests-314056552 None] Lock "cinder-8b8ab003-7970-4074-bfce-481f89b2d15e-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Flow 'volume_create_manager' (df3ad68b-2715-4bee-8013-175c3a098bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2279af-d30a-46ff-b3c0-dd5b69ebaff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2279af-d30a-46ff-b3c0-dd5b69ebaff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1399237177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f925586d-965b-4de7-ae65-808c7f31f06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0750a4e196d34ef7957a52e023465ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:28:21Z,use_quota=True,user_id='525210c7437a432cb8a88fe426c879fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b2873d-34cf-47c8-a12c-263527a99b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b2873d-34cf-47c8-a12c-263527a99b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a15eec-642b-4011-a3b3-164080ab22cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a15eec-642b-4011-a3b3-164080ab22cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f925586d-965b-4de7-ae65-808c7f31f06b', 'volume_name': 'volume-f925586d-965b-4de7-ae65-808c7f31f06b', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7363c3ab-76a4-4e3a-b453-51f8863492e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7363c3ab-76a4-4e3a-b453-51f8863492e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103724c9-2c8d-4065-83fc-bbdc8f090607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:21 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Volume f925586d-965b-4de7-ae65-808c7f31f06b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f925586d-965b-4de7-ae65-808c7f31f06b', 'volume_size': 1} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1399237177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f925586d-965b-4de7-ae65-808c7f31f06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0750a4e196d34ef7957a52e023465ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:28:21Z,use_quota=True,user_id='525210c7437a432cb8a88fe426c879fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Creating volume f925586d-965b-4de7-ae65-808c7f31f06b {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:28:21 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f925586d-965b-4de7-ae65-808c7f31f06b 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:21 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f925586d-965b-4de7-ae65-808c7f31f06b 1073741824 Jul 14 21:28:21 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:21 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f925586d-965b-4de7-ae65-808c7f31f06b 1073741824" returned: 0 in 0.630s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f925586d-965b-4de7-ae65-808c7f31f06b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:21 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f925586d-965b-4de7-ae65-808c7f31f06b Jul 14 21:28:21 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:22 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f925586d-965b-4de7-ae65-808c7f31f06b" returned: 0 in 0.282s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:28:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103724c9-2c8d-4065-83fc-bbdc8f090607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f925586d-965b-4de7-ae65-808c7f31f06b', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa32cd2-d2f2-4f1e-be39-e21fa1fc7086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:22 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Volume volume-f925586d-965b-4de7-ae65-808c7f31f06b (f925586d-965b-4de7-ae65-808c7f31f06b): created successfully Jul 14 21:28:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa32cd2-d2f2-4f1e-be39-e21fa1fc7086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Flow 'volume_create_manager' (df3ad68b-2715-4bee-8013-175c3a098bb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:28:22 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-b08abf86-19ff-41da-8ae7-28da6680dfce tempest-ProjectReaderTests-314056552 None] Created volume successfully. Jul 14 21:28:23 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] Acquiring lock "cinder-f925586d-965b-4de7-ae65-808c7f31f06b-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:28:23 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] Lock "cinder-f925586d-965b-4de7-ae65-808c7f31f06b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:28:23 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] Acquiring lock "cinder-quobyte-f925586d-965b-4de7-ae65-808c7f31f06b" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:28:23 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] Lock "cinder-quobyte-f925586d-965b-4de7-ae65-808c7f31f06b" acquired by "delete_volume" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:28:23 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78493dd-29af-4758-879e-5fb03a32c1a5]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:28:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f925586d-965b-4de7-ae65-808c7f31f06b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:23 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f925586d-965b-4de7-ae65-808c7f31f06b Jul 14 21:28:23 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:23 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f925586d-965b-4de7-ae65-808c7f31f06b" returned: 0 in 0.370s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f925586d-965b-4de7-ae65-808c7f31f06b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:23 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f925586d-965b-4de7-ae65-808c7f31f06b Jul 14 21:28:23 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:24 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f925586d-965b-4de7-ae65-808c7f31f06b" returned: 0 in 0.257s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] Lock "cinder-quobyte-f925586d-965b-4de7-ae65-808c7f31f06b" released by "delete_volume" :: held 0.665s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:28:24 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] Created reservations ['5f1ea75c-a910-4a97-9840-d9aae6d5f7ef', 'c78c06e5-0a60-48a7-b5a5-460095a2c8f8', '7e52aae8-cee7-4c71-9ac4-8d75aa491658', 'acdfb1bd-0b05-40f4-8a3f-4e8ac9e23baf'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:28:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:28:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:28:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:24 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:28:24 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:24 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.276s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:24 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:28:24 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] Deleted volume successfully. Jul 14 21:28:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-62db77f7-a31b-4a33-a7f6-cbcc9258149b tempest-ProjectReaderTests-314056552 None] Lock "cinder-f925586d-965b-4de7-ae65-808c7f31f06b-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:28:24 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:28:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Flow 'volume_create_manager' (7202d958-80fa-41ab-8329-5122fbbf235a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:28:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595266fe-c672-4013-8b67-2c95b8cda98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595266fe-c672-4013-8b67-2c95b8cda98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1379672716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771640c4-1456-45d1-ba2f-4cf1e7c1c344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0750a4e196d34ef7957a52e023465ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:28:25Z,use_quota=True,user_id='525210c7437a432cb8a88fe426c879fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (997b5eb0-ba95-4e69-b907-26ff0211587f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (997b5eb0-ba95-4e69-b907-26ff0211587f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816bd3f3-4d48-42c7-9b1e-0aa0d40dd0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816bd3f3-4d48-42c7-9b1e-0aa0d40dd0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '771640c4-1456-45d1-ba2f-4cf1e7c1c344', 'volume_name': 'volume-771640c4-1456-45d1-ba2f-4cf1e7c1c344', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92c56b5-490a-4b0d-b288-e76111a1fd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92c56b5-490a-4b0d-b288-e76111a1fd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00ed6cc8-70fb-4ab7-9d0c-e4312152173b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:25 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Volume 771640c4-1456-45d1-ba2f-4cf1e7c1c344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-771640c4-1456-45d1-ba2f-4cf1e7c1c344', 'volume_size': 1} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1379672716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771640c4-1456-45d1-ba2f-4cf1e7c1c344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0750a4e196d34ef7957a52e023465ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:28:25Z,use_quota=True,user_id='525210c7437a432cb8a88fe426c879fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Creating volume 771640c4-1456-45d1-ba2f-4cf1e7c1c344 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:28:25 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-771640c4-1456-45d1-ba2f-4cf1e7c1c344 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:25 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-771640c4-1456-45d1-ba2f-4cf1e7c1c344 1073741824 Jul 14 21:28:25 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:25 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-771640c4-1456-45d1-ba2f-4cf1e7c1c344 1073741824" returned: 0 in 0.407s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-771640c4-1456-45d1-ba2f-4cf1e7c1c344 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:25 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-771640c4-1456-45d1-ba2f-4cf1e7c1c344 Jul 14 21:28:25 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:25 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-771640c4-1456-45d1-ba2f-4cf1e7c1c344" returned: 0 in 0.263s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00ed6cc8-70fb-4ab7-9d0c-e4312152173b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-771640c4-1456-45d1-ba2f-4cf1e7c1c344', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e61f92-0a41-4611-82d9-5b51d8402233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:25 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Volume volume-771640c4-1456-45d1-ba2f-4cf1e7c1c344 (771640c4-1456-45d1-ba2f-4cf1e7c1c344): created successfully Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e61f92-0a41-4611-82d9-5b51d8402233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Flow 'volume_create_manager' (7202d958-80fa-41ab-8329-5122fbbf235a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:28:25 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-871b47f9-c56e-4c33-b0e6-c1a4ce09e300 tempest-ProjectReaderTests-314056552 None] Created volume successfully. Jul 14 21:28:26 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] Acquiring lock "cinder-771640c4-1456-45d1-ba2f-4cf1e7c1c344-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:28:26 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] Lock "cinder-771640c4-1456-45d1-ba2f-4cf1e7c1c344-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:28:26 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] Acquiring lock "cinder-quobyte-771640c4-1456-45d1-ba2f-4cf1e7c1c344" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:28:26 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] Lock "cinder-quobyte-771640c4-1456-45d1-ba2f-4cf1e7c1c344" acquired by "delete_volume" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:28:26 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9231a021-2ce6-4940-8365-42267bf6e446]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:28:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-771640c4-1456-45d1-ba2f-4cf1e7c1c344 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:26 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-771640c4-1456-45d1-ba2f-4cf1e7c1c344 Jul 14 21:28:26 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:26 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-771640c4-1456-45d1-ba2f-4cf1e7c1c344" returned: 0 in 0.372s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-771640c4-1456-45d1-ba2f-4cf1e7c1c344 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:26 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-771640c4-1456-45d1-ba2f-4cf1e7c1c344 Jul 14 21:28:26 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:26 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-771640c4-1456-45d1-ba2f-4cf1e7c1c344" returned: 0 in 0.267s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:26 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] Lock "cinder-quobyte-771640c4-1456-45d1-ba2f-4cf1e7c1c344" released by "delete_volume" :: held 0.677s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:28:26 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] Created reservations ['2983b6ab-e631-4283-b74a-1dde07c3e045', '54c880ca-fae1-4756-809d-64be3e3061a6', '883ea54e-f6f5-42da-b0ac-5cfcddc28024', '33eeec93-2ccf-4f79-b37f-105661d89c81'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:28:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:26 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:28:26 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:28:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:26 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:28:26 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:27 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.263s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:28:27 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] Deleted volume successfully. Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1c6b5dca-5516-4d10-884e-f61235f1f7c4 tempest-ProjectReaderTests-314056552 None] Lock "cinder-771640c4-1456-45d1-ba2f-4cf1e7c1c344-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Flow 'volume_create_manager' (6cc55837-bef5-4c6a-86ee-5e1b0295d1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0d3545-dc77-4122-9754-903c43e2218c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0d3545-dc77-4122-9754-903c43e2218c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2136314776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06707962-33d3-4c39-ac39-6a3f5be69aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0750a4e196d34ef7957a52e023465ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:28:28Z,use_quota=True,user_id='525210c7437a432cb8a88fe426c879fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717cac37-7724-469c-a534-2ae30106f57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717cac37-7724-469c-a534-2ae30106f57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07b7717-a6fa-4c7b-94d9-c93807af8802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07b7717-a6fa-4c7b-94d9-c93807af8802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06707962-33d3-4c39-ac39-6a3f5be69aa6', 'volume_name': 'volume-06707962-33d3-4c39-ac39-6a3f5be69aa6', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b26f36-f3b8-442f-9d1e-20b613fe8f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b26f36-f3b8-442f-9d1e-20b613fe8f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb91c1f-5279-4477-bcca-9c5525026717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:27 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Volume 06707962-33d3-4c39-ac39-6a3f5be69aa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06707962-33d3-4c39-ac39-6a3f5be69aa6', 'volume_size': 1} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2136314776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06707962-33d3-4c39-ac39-6a3f5be69aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0750a4e196d34ef7957a52e023465ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:28:28Z,use_quota=True,user_id='525210c7437a432cb8a88fe426c879fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Creating volume 06707962-33d3-4c39-ac39-6a3f5be69aa6 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:28:27 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:28:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06707962-33d3-4c39-ac39-6a3f5be69aa6 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:27 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06707962-33d3-4c39-ac39-6a3f5be69aa6 1073741824 Jul 14 21:28:27 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:28 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06707962-33d3-4c39-ac39-6a3f5be69aa6 1073741824" returned: 0 in 0.559s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06707962-33d3-4c39-ac39-6a3f5be69aa6 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:28 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06707962-33d3-4c39-ac39-6a3f5be69aa6 Jul 14 21:28:28 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:28 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06707962-33d3-4c39-ac39-6a3f5be69aa6" returned: 0 in 0.286s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:28 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:28:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb91c1f-5279-4477-bcca-9c5525026717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06707962-33d3-4c39-ac39-6a3f5be69aa6', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed70550-c27e-430c-8be7-cf8183706a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:28:28 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Volume volume-06707962-33d3-4c39-ac39-6a3f5be69aa6 (06707962-33d3-4c39-ac39-6a3f5be69aa6): created successfully Jul 14 21:28:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed70550-c27e-430c-8be7-cf8183706a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:28:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Flow 'volume_create_manager' (6cc55837-bef5-4c6a-86ee-5e1b0295d1f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:28:28 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-edd8b230-f726-4248-9969-abe6b6f7e387 tempest-ProjectReaderTests-314056552 None] Created volume successfully. Jul 14 21:28:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] Acquiring lock "cinder-06707962-33d3-4c39-ac39-6a3f5be69aa6-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:28:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] Lock "cinder-06707962-33d3-4c39-ac39-6a3f5be69aa6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:28:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] Acquiring lock "cinder-quobyte-06707962-33d3-4c39-ac39-6a3f5be69aa6" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:28:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] Lock "cinder-quobyte-06707962-33d3-4c39-ac39-6a3f5be69aa6" acquired by "delete_volume" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:28:29 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20cda9d-b601-47c0-8892-41fb0f2de72c]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:28:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06707962-33d3-4c39-ac39-6a3f5be69aa6 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:30 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06707962-33d3-4c39-ac39-6a3f5be69aa6 Jul 14 21:28:30 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:30 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06707962-33d3-4c39-ac39-6a3f5be69aa6" returned: 0 in 0.397s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06707962-33d3-4c39-ac39-6a3f5be69aa6 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:30 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06707962-33d3-4c39-ac39-6a3f5be69aa6 Jul 14 21:28:30 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:30 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-06707962-33d3-4c39-ac39-6a3f5be69aa6" returned: 0 in 0.253s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:30 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] Lock "cinder-quobyte-06707962-33d3-4c39-ac39-6a3f5be69aa6" released by "delete_volume" :: held 0.693s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:28:30 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] Created reservations ['bebecc11-5e88-448e-b7d9-431ecd89d0ab', '47ea1a0d-f04d-47f8-9166-490b6c305f18', '83cd623b-197d-4311-bff3-d72ee8f05175', 'f15a0d78-b1fa-4d1c-93d1-6bcbf8a4b2d7'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:28:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:28:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:28:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:30 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:28:30 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:31 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.281s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:31 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:28:31 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] Deleted volume successfully. Jul 14 21:28:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-112b8708-2006-4e9e-9dbf-dbc2252591b5 tempest-ProjectReaderTests-314056552 None] Lock "cinder-06707962-33d3-4c39-ac39-6a3f5be69aa6-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:28:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-b1ef52b1-68dc-48ee-9e1d-b28b55c8531e req-360eeaa9-b5c0-41b3-a4b1-8669c059c267 tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-b1ef52b1-68dc-48ee-9e1d-b28b55c8531e req-360eeaa9-b5c0-41b3-a4b1-8669c059c267 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:33 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79ecc19-5afa-4b9d-acd6-52e58000e59f]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:28:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-b1ef52b1-68dc-48ee-9e1d-b28b55c8531e req-360eeaa9-b5c0-41b3-a4b1-8669c059c267 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a32b0670-9a7d-4b73-98f3-81536422f39c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:33 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a32b0670-9a7d-4b73-98f3-81536422f39c Jul 14 21:28:33 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:34 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-b1ef52b1-68dc-48ee-9e1d-b28b55c8531e req-360eeaa9-b5c0-41b3-a4b1-8669c059c267 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a32b0670-9a7d-4b73-98f3-81536422f39c" returned: 0 in 0.368s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-b1ef52b1-68dc-48ee-9e1d-b28b55c8531e req-360eeaa9-b5c0-41b3-a4b1-8669c059c267 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.389s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-b1ef52b1-68dc-48ee-9e1d-b28b55c8531e req-360eeaa9-b5c0-41b3-a4b1-8669c059c267 tempest-TestInstancesWithCinderVolumes-297499416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-a32b0670-9a7d-4b73-98f3-81536422f39c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22f3fe46-0d3d-4ed8-b9a0-4c5077bf0165', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:28:34 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-b1ef52b1-68dc-48ee-9e1d-b28b55c8531e req-360eeaa9-b5c0-41b3-a4b1-8669c059c267 tempest-TestInstancesWithCinderVolumes-297499416 None] attachment_update completed successfully. Jul 14 21:28:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:28:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:28:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:28:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:36 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:28:36 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:37 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.487s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:37 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:28:37 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:28:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 28 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:28:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:28:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-519e5e5d-92e8-4a28-bbaf-1c70d9d72c42 req-07f369b9-851d-40d3-84bd-fe6a67715439 tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-519e5e5d-92e8-4a28-bbaf-1c70d9d72c42 req-07f369b9-851d-40d3-84bd-fe6a67715439 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:37 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d9c1f0-8cbf-4eb0-b0f6-12649c6c64b7]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:28:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-519e5e5d-92e8-4a28-bbaf-1c70d9d72c42 req-07f369b9-851d-40d3-84bd-fe6a67715439 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:37 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad Jul 14 21:28:37 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:37 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-519e5e5d-92e8-4a28-bbaf-1c70d9d72c42 req-07f369b9-851d-40d3-84bd-fe6a67715439 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad" returned: 0 in 0.465s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-519e5e5d-92e8-4a28-bbaf-1c70d9d72c42 req-07f369b9-851d-40d3-84bd-fe6a67715439 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.486s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-519e5e5d-92e8-4a28-bbaf-1c70d9d72c42 req-07f369b9-851d-40d3-84bd-fe6a67715439 tempest-TestInstancesWithCinderVolumes-297499416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15a169df-eb8c-47df-a846-4a36aa930727', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:28:37 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-519e5e5d-92e8-4a28-bbaf-1c70d9d72c42 req-07f369b9-851d-40d3-84bd-fe6a67715439 tempest-TestInstancesWithCinderVolumes-297499416 None] attachment_update completed successfully. Jul 14 21:28:41 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-aa542cb9-a691-44f9-91d6-834b3f331120 req-adfc2f33-e21b-4349-a38b-77891b58f05f tempest-TestShelveInstance-1861996334 None] Terminate volume connection completed successfully. Jul 14 21:28:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-aa542cb9-a691-44f9-91d6-834b3f331120 req-adfc2f33-e21b-4349-a38b-77891b58f05f tempest-TestShelveInstance-1861996334 None] Deleting attachment 93c7d236-7606-498c-b747-d86cb6f46e55. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:28:44 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-4c1a7e8f-dc59-4a4c-ac97-250b5feefbc1 req-913bc6a0-9f9a-4d09-abcd-6108df7453ed tempest-TestInstancesWithCinderVolumes-297499416 None] Terminate volume connection completed successfully. Jul 14 21:28:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-4c1a7e8f-dc59-4a4c-ac97-250b5feefbc1 req-913bc6a0-9f9a-4d09-abcd-6108df7453ed tempest-TestInstancesWithCinderVolumes-297499416 None] Deleting attachment 22f3fe46-0d3d-4ed8-b9a0-4c5077bf0165. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:28:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-4de04fcc-f452-44cc-aec6-fda27e05b28f req-95f5b658-09d5-4ea1-9cdf-623821ebd5cf tempest-TestShelveInstance-1861996334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-4de04fcc-f452-44cc-aec6-fda27e05b28f req-95f5b658-09d5-4ea1-9cdf-623821ebd5cf tempest-TestShelveInstance-1861996334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:44 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7e531a-9f2d-4717-8997-6ef7e813e872]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:28:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-4de04fcc-f452-44cc-aec6-fda27e05b28f req-95f5b658-09d5-4ea1-9cdf-623821ebd5cf tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:44 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 Jul 14 21:28:44 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "cinder-a32b0670-9a7d-4b73-98f3-81536422f39c-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:28:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "cinder-a32b0670-9a7d-4b73-98f3-81536422f39c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:28:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "cinder-quobyte-a32b0670-9a7d-4b73-98f3-81536422f39c" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:28:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "cinder-quobyte-a32b0670-9a7d-4b73-98f3-81536422f39c" acquired by "delete_volume" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:28:44 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17e4d03-515f-4eee-97a8-c13252ef9347]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:28:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a32b0670-9a7d-4b73-98f3-81536422f39c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:44 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-4de04fcc-f452-44cc-aec6-fda27e05b28f req-95f5b658-09d5-4ea1-9cdf-623821ebd5cf tempest-TestShelveInstance-1861996334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81" returned: 0 in 0.435s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-4de04fcc-f452-44cc-aec6-fda27e05b28f req-95f5b658-09d5-4ea1-9cdf-623821ebd5cf tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:44 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a32b0670-9a7d-4b73-98f3-81536422f39c Jul 14 21:28:44 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:45 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 Jul 14 21:28:45 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:45 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a32b0670-9a7d-4b73-98f3-81536422f39c" returned: 0 in 0.418s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a32b0670-9a7d-4b73-98f3-81536422f39c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:45 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a32b0670-9a7d-4b73-98f3-81536422f39c Jul 14 21:28:45 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:45 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-4de04fcc-f452-44cc-aec6-fda27e05b28f req-95f5b658-09d5-4ea1-9cdf-623821ebd5cf tempest-TestShelveInstance-1861996334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81" returned: 1 in 0.430s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-4de04fcc-f452-44cc-aec6-fda27e05b28f req-95f5b658-09d5-4ea1-9cdf-623821ebd5cf tempest-TestShelveInstance-1861996334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:28:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-4de04fcc-f452-44cc-aec6-fda27e05b28f req-95f5b658-09d5-4ea1-9cdf-623821ebd5cf tempest-TestShelveInstance-1861996334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.932s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:45 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-4de04fcc-f452-44cc-aec6-fda27e05b28f req-95f5b658-09d5-4ea1-9cdf-623821ebd5cf tempest-TestShelveInstance-1861996334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8', 'name': 'volume-f062281a-03b9-41d2-af02-bfe533e82d81', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81ac5718-16d4-4be8-8e40-c6f2af1ef2fc', 'enforce_multipath': True} {{(pid=88300) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 14 21:28:45 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-4de04fcc-f452-44cc-aec6-fda27e05b28f req-95f5b658-09d5-4ea1-9cdf-623821ebd5cf tempest-TestShelveInstance-1861996334 None] attachment_update completed successfully. Jul 14 21:28:45 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a32b0670-9a7d-4b73-98f3-81536422f39c" returned: 0 in 0.443s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:45 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "cinder-quobyte-a32b0670-9a7d-4b73-98f3-81536422f39c" released by "delete_volume" :: held 0.922s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:28:45 devstack cinder-volume[88300]: WARNING cinder.quota [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1771436771-390715084 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1771436771-390715084, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:28:45 devstack cinder-volume[88300]: WARNING cinder.quota [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1771436771-390715084 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1771436771-390715084, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:28:45 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Created reservations ['7e009ff2-e791-492e-afa9-7e78a01dee59', '8472fea3-56eb-4c4e-b767-8031d0a97a5a', '8c32a8ea-2fc4-46cf-a99a-4a3730d915f3', '346fbd0a-8342-4f16-9def-033bff91cf27'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:28:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:45 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:28:45 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:28:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:45 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:28:45 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:46 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.386s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:46 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:28:46 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Deleted volume successfully. Jul 14 21:28:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0bb11466-55bb-49c5-ac2a-76d4efb9d2ac tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "cinder-a32b0670-9a7d-4b73-98f3-81536422f39c-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:28:49 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-82aacfa7-0905-4f21-9e9c-7a6b61191556 req-debbfa3a-1cc6-4bc6-a622-36019d9e095b tempest-TestInstancesWithCinderVolumes-297499416 None] Terminate volume connection completed successfully. Jul 14 21:28:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-82aacfa7-0905-4f21-9e9c-7a6b61191556 req-debbfa3a-1cc6-4bc6-a622-36019d9e095b tempest-TestInstancesWithCinderVolumes-297499416 None] Deleting attachment 15a169df-eb8c-47df-a846-4a36aa930727. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:28:50 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "cinder-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:28:50 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "cinder-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:28:50 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "cinder-quobyte-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:28:50 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "cinder-quobyte-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad" acquired by "delete_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:28:50 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3af535-bdb5-4605-b7fb-333b7891230c]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:28:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:50 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad Jul 14 21:28:50 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:51 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad" returned: 0 in 0.843s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:51 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad Jul 14 21:28:51 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:51 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad" returned: 0 in 0.487s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:51 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "cinder-quobyte-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad" released by "delete_volume" :: held 1.473s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:28:51 devstack cinder-volume[88300]: WARNING cinder.quota [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1907910209-692953407 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1907910209-692953407, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:28:51 devstack cinder-volume[88300]: WARNING cinder.quota [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1907910209-692953407 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1907910209-692953407, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:28:51 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Created reservations ['c5cc568c-da78-4510-82d5-ee77eeaf6b63', '959fd1ca-1ca9-42c4-a720-043708972b39', '75f540df-d2e4-462b-ac00-f140ea982297', '57ec7a31-9670-435b-be29-939b6445e3d2'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:28:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:28:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:28:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:28:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:28:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:28:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:28:51 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:28:51 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:28:52 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 14 21:28:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.693s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:28:52 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:28:52 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Deleted volume successfully. Jul 14 21:28:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1f84c330-7134-4194-9ae3-5a0462e2e5c6 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "cinder-d6f7cecb-d9e2-4458-af82-7695e6d5d7ad-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:28:58 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-d2991ec6-ba9d-4074-8a40-fd4ca07a650c req-da2c618d-fbbd-4ae5-9681-ef32720f6580 tempest-TestInstancesWithCinderVolumes-297499416 None] Terminate volume connection completed successfully. Jul 14 21:28:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-d2991ec6-ba9d-4074-8a40-fd4ca07a650c req-da2c618d-fbbd-4ae5-9681-ef32720f6580 tempest-TestInstancesWithCinderVolumes-297499416 None] Deleting attachment eb8c9ddb-77cc-4894-894e-dd2a199ca4db. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:28:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "cinder-cd37c945-c049-45c9-ab1e-42b4f7d8edf3-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:28:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "cinder-cd37c945-c049-45c9-ab1e-42b4f7d8edf3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:28:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "cinder-quobyte-cd37c945-c049-45c9-ab1e-42b4f7d8edf3" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:28:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "cinder-quobyte-cd37c945-c049-45c9-ab1e-42b4f7d8edf3" acquired by "delete_volume" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:28:59 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d610b890-c6e7-49db-a322-179d273a1cf1]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:28:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:00 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 Jul 14 21:29:00 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:00 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3" returned: 0 in 0.477s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:00 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 Jul 14 21:29:00 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:00 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3" returned: 1 in 0.459s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:29:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:00 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3 Jul 14 21:29:00 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:01 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd37c945-c049-45c9-ab1e-42b4f7d8edf3" returned: 0 in 0.425s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "cinder-quobyte-cd37c945-c049-45c9-ab1e-42b4f7d8edf3" released by "delete_volume" :: held 1.499s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:01 devstack cinder-volume[88300]: WARNING cinder.quota [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-599794081-1704046281 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-599794081-1704046281, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:29:01 devstack cinder-volume[88300]: WARNING cinder.quota [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-599794081-1704046281 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-599794081-1704046281, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Created reservations ['fb417603-2935-4882-9d1b-23d3848086ca', '1d030db2-efc7-49aa-a5ff-d275773adc2c', '9e6c437e-6fd1-4c32-b599-12c34462e52d', '9cfd33fc-e660-4aff-8d81-5f6bd5cc3d0a'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Flow 'volume_create_manager' (6f3e03ca-f0b2-4632-8d49-275f2a05f088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e60b31d-5858-4878-8875-9996659b06e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e60b31d-5858-4878-8875-9996659b06e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1885377755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f26ad9f0-c365-446a-8b13-36a721ca2f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74dff2cb209c473da0791e79f39c12d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:01Z,use_quota=True,user_id='4efc4c6d254a4b3f80b8e4df0a9a3c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2e1231-5a9e-4770-92b3-5fb730d6a9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2e1231-5a9e-4770-92b3-5fb730d6a9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c43fc7f1-6fca-47d5-a7db-2ba7cb78cde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c43fc7f1-6fca-47d5-a7db-2ba7cb78cde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f26ad9f0-c365-446a-8b13-36a721ca2f9a', 'volume_name': 'volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba1589a-c23e-4acf-8f23-c629ceaf1384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba1589a-c23e-4acf-8f23-c629ceaf1384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20014790-fa39-4785-bff6-d3e05c2b6530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:01 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Volume f26ad9f0-c365-446a-8b13-36a721ca2f9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a', 'volume_size': 1} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1885377755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f26ad9f0-c365-446a-8b13-36a721ca2f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74dff2cb209c473da0791e79f39c12d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:01Z,use_quota=True,user_id='4efc4c6d254a4b3f80b8e4df0a9a3c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Creating volume f26ad9f0-c365-446a-8b13-36a721ca2f9a {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:29:01 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:01 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a 1073741824 Jul 14 21:29:01 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:01 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:29:01 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:01 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.333s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:01 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:29:01 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Deleted volume successfully. Jul 14 21:29:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-59ce5b7c-51c0-4591-b1bb-476d9eea22e9 tempest-TestInstancesWithCinderVolumes-297499416 None] Lock "cinder-cd37c945-c049-45c9-ab1e-42b4f7d8edf3-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:02 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a 1073741824" returned: 0 in 0.720s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:02 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a Jul 14 21:29:02 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:02 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a" returned: 0 in 0.319s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:29:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20014790-fa39-4785-bff6-d3e05c2b6530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc93afb-0e8e-4c3f-821d-a8a992457c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:02 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Volume volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a (f26ad9f0-c365-446a-8b13-36a721ca2f9a): created successfully Jul 14 21:29:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc93afb-0e8e-4c3f-821d-a8a992457c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Flow 'volume_create_manager' (6f3e03ca-f0b2-4632-8d49-275f2a05f088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:02 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-14c711dc-2c46-4a4f-983b-42d57a84143a tempest-SnapshotDependencyTests-1099750009 None] Created volume successfully. Jul 14 21:29:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] Creating offline snapshot a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 of volume f26ad9f0-c365-446a-8b13-36a721ca2f9a {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:29:03 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d373c0e7-6873-4544-85de-ebe524506ea6]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:04 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a Jul 14 21:29:04 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:04 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a" returned: 0 in 0.370s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:04 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 1G Jul 14 21:29:04 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:04 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 1G" returned: 0 in 0.487s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:04 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 Jul 14 21:29:04 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:05 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2" returned: 0 in 0.322s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:05 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 is being set with open permissions: ugo+rw Jul 14 21:29:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:05 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 Jul 14 21:29:05 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:05 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2" returned: 0 in 0.272s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:05 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.info Jul 14 21:29:05 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:05 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.info" returned: 0 in 0.304s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:05 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.info is being set with open permissions: ugo+rw Jul 14 21:29:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:05 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.info Jul 14 21:29:05 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:06 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.info" returned: 0 in 0.390s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:06 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-46f2caae-a263-4161-9cd1-7caefe0ee2e7 tempest-SnapshotDependencyTests-1099750009 None] Create snapshot completed successfully Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Flow 'volume_create_manager' (f0677a79-3958-416a-b95e-8871aa5cb65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500a7a41-9561-4a9e-9423-646db8920b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500a7a41-9561-4a9e-9423-646db8920b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c6ed77-22c6-481a-9aa5-8eec6428df3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74dff2cb209c473da0791e79f39c12d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a48a56ba-065d-4d5f-ab5d-50658b4aa1b2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:08Z,use_quota=True,user_id='4efc4c6d254a4b3f80b8e4df0a9a3c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1edd16-99ea-487c-a78e-dc71473ce020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1edd16-99ea-487c-a78e-dc71473ce020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2c162e-4c78-4f8b-9163-5247d9ce413e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2c162e-4c78-4f8b-9163-5247d9ce413e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '69c6ed77-22c6-481a-9aa5-8eec6428df3e', 'volume_name': 'volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e', 'volume_size': 1, 'snapshot_id': 'a48a56ba-065d-4d5f-ab5d-50658b4aa1b2'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c40fbb8-0a41-426d-8e9e-3a0ff5234ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c40fbb8-0a41-426d-8e9e-3a0ff5234ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8f70ed-7171-4726-a59f-bc81beddf8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:07 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Volume 69c6ed77-22c6-481a-9aa5-8eec6428df3e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e', 'volume_size': 1, 'snapshot_id': 'a48a56ba-065d-4d5f-ab5d-50658b4aa1b2'} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Acquiring lock "cinder-quobyte-a48a56ba-065d-4d5f-ab5d-50658b4aa1b2-69c6ed77-22c6-481a-9aa5-8eec6428df3e" by "_create_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-quobyte-a48a56ba-065d-4d5f-ab5d-50658b4aa1b2-69c6ed77-22c6-481a-9aa5-8eec6428df3e" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Creating volume 69c6ed77-22c6-481a-9aa5-8eec6428df3e from snapshot a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 {{(pid=88300) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Acquiring lock "cinder-quobyte-69c6ed77-22c6-481a-9aa5-8eec6428df3e" by "_copy_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-quobyte-69c6ed77-22c6-481a-9aa5-8eec6428df3e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] snapshot: a48a56ba-065d-4d5f-ab5d-50658b4aa1b2, volume: 69c6ed77-22c6-481a-9aa5-8eec6428df3e, {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa13f97-faa0-47ba-87a5-6ab491a92883]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:08 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 Jul 14 21:29:08 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:08 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2" returned: 0 in 0.386s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:08 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:29:08 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 21:29:08 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Creating direct copy from snapshot {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 21:29:08 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab45427e-3267-4f8a-85dd-c331b38b2d3c]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:08 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a Jul 14 21:29:08 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:08 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a" returned: 0 in 0.428s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:08 devstack cinder-volume[88300]: DEBUG cinder.utils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Path /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e not found in is_blk_device check {{(pid=88300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 21:29:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:08 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e Jul 14 21:29:08 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:13 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e" returned: 0 in 4.990s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:13 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08dcf09-83a5-494d-b5d2-a297075a346a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:13 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a Jul 14 21:29:13 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:14 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a" returned: 0 in 0.573s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:14 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Image conversion details: src /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a, size 1024.00 MB, duration 4.99 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:29:14 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Converted 1024.00 MB image at 205.14 MB/s Jul 14 21:29:14 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e is being set with open permissions: ugo+rw Jul 14 21:29:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:14 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e Jul 14 21:29:14 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:14 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e" returned: 0 in 0.289s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-quobyte-69c6ed77-22c6-481a-9aa5-8eec6428df3e" released by "_copy_volume_from_snapshot" :: held 6.762s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-quobyte-a48a56ba-065d-4d5f-ab5d-50658b4aa1b2-69c6ed77-22c6-481a-9aa5-8eec6428df3e" released by "_create_volume_from_snapshot" :: held 6.794s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.812s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8f70ed-7171-4726-a59f-bc81beddf8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e', 'volume_size': 1, 'snapshot_id': 'a48a56ba-065d-4d5f-ab5d-50658b4aa1b2'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96c6185f-05c9-4a71-a605-f4c46382c7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:14 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Volume volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e (69c6ed77-22c6-481a-9aa5-8eec6428df3e): created successfully Jul 14 21:29:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96c6185f-05c9-4a71-a605-f4c46382c7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Flow 'volume_create_manager' (f0677a79-3958-416a-b95e-8871aa5cb65e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:14 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-36b3a45c-6c1c-4bca-92c2-dda4a29cf8ce tempest-SnapshotDependencyTests-1099750009 None] Created volume successfully. Jul 14 21:29:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] Acquiring lock "cinder-a48a56ba-065d-4d5f-ab5d-50658b4aa1b2-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-a48a56ba-065d-4d5f-ab5d-50658b4aa1b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] Acquiring lock "cinder-quobyte-f26ad9f0-c365-446a-8b13-36a721ca2f9a" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-quobyte-f26ad9f0-c365-446a-8b13-36a721ca2f9a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] Acquiring lock "cinder-quobyte-a48a56ba-065d-4d5f-ab5d-50658b4aa1b2" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-quobyte-a48a56ba-065d-4d5f-ab5d-50658b4aa1b2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] Deleting offline snapshot a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 of volume f26ad9f0-c365-446a-8b13-36a721ca2f9a {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:29:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] snapshot_file for this snap is: volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:29:15 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca21915-5826-49c2-9b0d-6ef6c26f16a2]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:15 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 Jul 14 21:29:15 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:16 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2" returned: 0 in 0.410s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:29:16 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7152af-68a6-46f3-a616-92c486520fc4]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:16 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a Jul 14 21:29:16 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:16 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a" returned: 0 in 0.367s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:16 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 Jul 14 21:29:16 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:16 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2" returned: 0 in 0.340s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:16 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2 Jul 14 21:29:16 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:17 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a.a48a56ba-065d-4d5f-ab5d-50658b4aa1b2" returned: 0 in 0.247s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:17 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:UPDATE=79,cinder:SELECT=80,cinder:INSERT=18,cinder:DELETE=4 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:29:17 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=65,cinder:UPDATE=79,cinder:INSERT=16,cinder:DELETE=10 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:29:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-quobyte-a48a56ba-065d-4d5f-ab5d-50658b4aa1b2" released by "_delete_snapshot" :: held 1.484s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-quobyte-f26ad9f0-c365-446a-8b13-36a721ca2f9a" released by "delete_snapshot" :: held 1.507s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:17 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] Created reservations ['68aaaf02-e994-4b7b-9989-bdf326a50c9a', '571ccce4-8e15-4e67-9ede-94e096e52bb5', 'aa80e969-b070-411b-808c-f7bf32c0032f', 'c85cf738-a0e6-4633-96d1-1803a651b65e'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:29:17 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] Delete snapshot completed successfully. Jul 14 21:29:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8b104a03-9aad-4aa0-a844-2a8aec2b3743 tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-a48a56ba-065d-4d5f-ab5d-50658b4aa1b2-delete_snapshot" released by "delete_snapshot" :: held 1.656s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] Acquiring lock "cinder-f26ad9f0-c365-446a-8b13-36a721ca2f9a-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-f26ad9f0-c365-446a-8b13-36a721ca2f9a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] Acquiring lock "cinder-quobyte-f26ad9f0-c365-446a-8b13-36a721ca2f9a" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-quobyte-f26ad9f0-c365-446a-8b13-36a721ca2f9a" acquired by "delete_volume" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:17 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3817576-b759-4987-bb61-bffb1527e10a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:18 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a Jul 14 21:29:18 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:18 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a" returned: 0 in 0.386s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:18 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a Jul 14 21:29:18 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:18 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f26ad9f0-c365-446a-8b13-36a721ca2f9a" returned: 0 in 0.250s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-quobyte-f26ad9f0-c365-446a-8b13-36a721ca2f9a" released by "delete_volume" :: held 0.700s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:18 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] Created reservations ['87840a9c-a2a2-43b5-8e99-ae7dd3d6322a', '89c1300d-afad-4014-a4a6-50d6527ee405', '43eca27b-aeba-4ceb-94aa-f0c704749ec5', '0072a191-1f32-4781-a7fe-3f5f528b8cfe'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:29:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:18 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:29:18 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:19 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.267s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:29:19 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] Deleted volume successfully. Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] Acquiring lock "cinder-69c6ed77-22c6-481a-9aa5-8eec6428df3e-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-607fe31d-3b85-429b-b0d9-2cb4435a7a88 tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-f26ad9f0-c365-446a-8b13-36a721ca2f9a-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-69c6ed77-22c6-481a-9aa5-8eec6428df3e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] Acquiring lock "cinder-quobyte-69c6ed77-22c6-481a-9aa5-8eec6428df3e" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-quobyte-69c6ed77-22c6-481a-9aa5-8eec6428df3e" acquired by "delete_volume" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb47a5f-9f3d-436a-ba44-ea090f2c6d5c]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:19 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e Jul 14 21:29:19 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:19 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e" returned: 0 in 0.389s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:19 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e Jul 14 21:29:19 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Flow 'volume_create_manager' (c0874861-5754-4f3d-bedc-517c5562db05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (862b3a72-9b07-4d89-ad21-379100a9c755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (862b3a72-9b07-4d89-ad21-379100a9c755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5c275d-7fbf-4591-a042-42f03779ee38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39774a8203741258f149d3aadbee281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:20Z,use_quota=True,user_id='54e7682a38fd46a6a4a8e7a438609b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b583097-a3ce-449b-8494-c0fe5f646848),volume_type_id=6b583097-a3ce-449b-8494-c0fe5f646848)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff03b014-8663-48b6-953d-a7563aaf2ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff03b014-8663-48b6-953d-a7563aaf2ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182c434d-4b52-47a1-9963-e32e381d2016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:19 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.image.glance [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Creating Keystone auth plugin from conf {{(pid=88300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-69c6ed77-22c6-481a-9aa5-8eec6428df3e" returned: 0 in 0.268s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-quobyte-69c6ed77-22c6-481a-9aa5-8eec6428df3e" released by "delete_volume" :: held 0.703s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] Created reservations ['dd74ef3f-fa56-44cd-9d60-bdf8d31aac8e', 'c8a6f742-ec2e-479d-9dfb-fae22ca5a032', '5beed659-16e1-4aff-bd51-99501535dcf6', 'f0f1fcca-17fc-4d7c-8068-c469a532529f'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:20 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:29:20 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182c434d-4b52-47a1-9963-e32e381d2016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5c5c275d-7fbf-4591-a042-42f03779ee38', 'volume_name': 'volume-5c5c275d-7fbf-4591-a042-42f03779ee38', 'volume_size': 1, 'image_id': '5ac572cb-2f60-45df-a1f0-bcbe936a56ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ac572cb-2f60-45df-a1f0-bcbe936a56ed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c11077ff1853e785ea238399b819f487', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c39774a8203741258f149d3aadbee281', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42c0af891fe054c687a7c20d99aa5cbf7b6f6c7c59f332e4cd0821934a966cd6a95352a8a476aa52a38caea17577c6094f52337407f74fd734311e284f0e559a', 'id': '5ac572cb-2f60-45df-a1f0-bcbe936a56ed', 'created_at': datetime.datetime(2026, 7, 14, 19, 29, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 29, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ac572cb-2f60-45df-a1f0-bcbe936a56ed/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e9d47b-7359-4773-be2e-746bbb3cdf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e9d47b-7359-4773-be2e-746bbb3cdf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525dadc3-c01d-46a7-8c50-97457d65bff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:20 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Volume 5c5c275d-7fbf-4591-a042-42f03779ee38: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5c5c275d-7fbf-4591-a042-42f03779ee38', 'volume_size': 1, 'image_id': '5ac572cb-2f60-45df-a1f0-bcbe936a56ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ac572cb-2f60-45df-a1f0-bcbe936a56ed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c11077ff1853e785ea238399b819f487', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c39774a8203741258f149d3aadbee281', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42c0af891fe054c687a7c20d99aa5cbf7b6f6c7c59f332e4cd0821934a966cd6a95352a8a476aa52a38caea17577c6094f52337407f74fd734311e284f0e559a', 'id': '5ac572cb-2f60-45df-a1f0-bcbe936a56ed', 'created_at': datetime.datetime(2026, 7, 14, 19, 29, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 29, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ac572cb-2f60-45df-a1f0-bcbe936a56ed/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 14 21:29:20 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Trying to clone 5c5c275d-7fbf-4591-a042-42f03779ee38 from image 5ac572cb-2f60-45df-a1f0-bcbe936a56ed at location (None, [{'url': 'file:///opt/stack/data/glance/images/5ac572cb-2f60-45df-a1f0-bcbe936a56ed', 'metadata': {}}]). {{(pid=88300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 21:29:20 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 21:29:20 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Image download 0.00 MB at 0.00 MB/s Jul 14 21:29:20 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[94daf32e-ebf1-49ae-a9bb-78357ee79827]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:20 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.289s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:20 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:29:20 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] Deleted volume successfully. Jul 14 21:29:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5707d568-4e7b-4535-b02e-096113c2842a tempest-SnapshotDependencyTests-1099750009 None] Lock "cinder-69c6ed77-22c6-481a-9aa5-8eec6428df3e-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:20 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD Jul 14 21:29:20 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:20 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:20 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD Jul 14 21:29:20 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:20 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:29:20 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Temporary image 5ac572cb-2f60-45df-a1f0-bcbe936a56ed is fetched for user 54e7682a38fd46a6a4a8e7a438609b03. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 21:29:21 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d23ab64-8d40-4e34-aa5e-f59942ae65a0]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:21 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD Jul 14 21:29:21 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:21 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:21 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD Jul 14 21:29:21 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:21 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD" returned: 1 in 0.332s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:29:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5c275d-7fbf-4591-a042-42f03779ee38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c39774a8203741258f149d3aadbee281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:20Z,use_quota=True,user_id='54e7682a38fd46a6a4a8e7a438609b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b583097-a3ce-449b-8494-c0fe5f646848),volume_type_id=6b583097-a3ce-449b-8494-c0fe5f646848)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:29:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Creating volume 5c5c275d-7fbf-4591-a042-42f03779ee38 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:29:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:29:21 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:29:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:21 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 1073741824 Jul 14 21:29:21 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:22 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 1073741824" returned: 0 in 0.461s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:22 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 Jul 14 21:29:22 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:22 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38" returned: 0 in 0.245s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:29:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:22 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Attempting download of 5ac572cb-2f60-45df-a1f0-bcbe936a56ed ((None, [{'url': 'file:///opt/stack/data/glance/images/5ac572cb-2f60-45df-a1f0-bcbe936a56ed', 'metadata': {}}])) to volume 5c5c275d-7fbf-4591-a042-42f03779ee38. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 21:29:22 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5be8b33-742c-44c6-84a6-dd49bcffc4fc]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_e7kts_y0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:22 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_e7kts_y0 Jul 14 21:29:22 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:22 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_e7kts_y0" returned: 0 in 0.363s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_e7kts_y0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:23 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_e7kts_y0 Jul 14 21:29:23 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:23 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_e7kts_y0" returned: 1 in 0.359s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_e7kts_y0' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:29:23 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b57579-cf5d-41f4-8bcf-928536b89064]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:23 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD Jul 14 21:29:23 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:23 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:23 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD Jul 14 21:29:23 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:24 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD" returned: 1 in 0.388s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:29:24 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] 5ac572cb-2f60-45df-a1f0-bcbe936a56ed was raw, converting to raw {{(pid=88300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 21:29:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:24 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 Jul 14 21:29:24 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:24 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38" returned: 0 in 0.322s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:24 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5ac572cb-2f60-45df-a1f0-bcbe936a56ed_hx_mwq0ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:29:24 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Converted 0.00 MB image at 0.00 MB/s Jul 14 21:29:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:24 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 1G Jul 14 21:29:24 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:24 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 1G" returned: 0 in 0.293s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:24 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[305ef009-2a37-4285-8196-cbfd513371db]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:24 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 Jul 14 21:29:24 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:25 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38" returned: 0 in 0.381s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:25 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 Jul 14 21:29:25 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:25 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38" returned: 1 in 0.382s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:29:25 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Downloaded image 5ac572cb-2f60-45df-a1f0-bcbe936a56ed ((None, [{'url': 'file:///opt/stack/data/glance/images/5ac572cb-2f60-45df-a1f0-bcbe936a56ed', 'metadata': {}}])) to volume 5c5c275d-7fbf-4591-a042-42f03779ee38 successfully. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 21:29:25 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Temporary image 5ac572cb-2f60-45df-a1f0-bcbe936a56ed for user 54e7682a38fd46a6a4a8e7a438609b03 is deleted. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 21:29:25 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Marking volume 5c5c275d-7fbf-4591-a042-42f03779ee38 as bootable. {{(pid=88300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 21:29:25 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Copying metadata from image 5ac572cb-2f60-45df-a1f0-bcbe936a56ed to 5c5c275d-7fbf-4591-a042-42f03779ee38. {{(pid=88300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 21:29:25 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Creating volume glance metadata for volume 5c5c275d-7fbf-4591-a042-42f03779ee38 backed by image 5ac572cb-2f60-45df-a1f0-bcbe936a56ed with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5ac572cb-2f60-45df-a1f0-bcbe936a56ed', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c11077ff1853e785ea238399b819f487', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 21:29:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525dadc3-c01d-46a7-8c50-97457d65bff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c5c275d-7fbf-4591-a042-42f03779ee38', 'volume_size': 1, 'image_id': '5ac572cb-2f60-45df-a1f0-bcbe936a56ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ac572cb-2f60-45df-a1f0-bcbe936a56ed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c11077ff1853e785ea238399b819f487', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c39774a8203741258f149d3aadbee281', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42c0af891fe054c687a7c20d99aa5cbf7b6f6c7c59f332e4cd0821934a966cd6a95352a8a476aa52a38caea17577c6094f52337407f74fd734311e284f0e559a', 'id': '5ac572cb-2f60-45df-a1f0-bcbe936a56ed', 'created_at': datetime.datetime(2026, 7, 14, 19, 29, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 29, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ac572cb-2f60-45df-a1f0-bcbe936a56ed/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8841c24e-a258-4141-b6c6-ad3df59dcf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:25 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Volume volume-5c5c275d-7fbf-4591-a042-42f03779ee38 (5c5c275d-7fbf-4591-a042-42f03779ee38): created successfully Jul 14 21:29:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8841c24e-a258-4141-b6c6-ad3df59dcf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Flow 'volume_create_manager' (c0874861-5754-4f3d-bedc-517c5562db05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:25 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d6bd7905-6458-4c46-80d6-17a5f571c280 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Created volume successfully. Jul 14 21:29:26 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Acquiring lock "cinder-5c5c275d-7fbf-4591-a042-42f03779ee38-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:26 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Lock "cinder-5c5c275d-7fbf-4591-a042-42f03779ee38-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:26 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Acquiring lock "cinder-quobyte-5c5c275d-7fbf-4591-a042-42f03779ee38" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:26 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Lock "cinder-quobyte-5c5c275d-7fbf-4591-a042-42f03779ee38" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:26 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1551d219-f680-4a97-873f-6dee1860c1d1]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:26 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 Jul 14 21:29:26 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:26 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38" returned: 0 in 0.414s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:26 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 Jul 14 21:29:26 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:27 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38" returned: 1 in 0.370s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:29:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:27 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38 Jul 14 21:29:27 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:27 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5c5c275d-7fbf-4591-a042-42f03779ee38" returned: 0 in 0.263s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Lock "cinder-quobyte-5c5c275d-7fbf-4591-a042-42f03779ee38" released by "delete_volume" :: held 1.119s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:27 devstack cinder-volume[88300]: WARNING cinder.quota [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:29:27 devstack cinder-volume[88300]: WARNING cinder.quota [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 14 21:29:27 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Created reservations ['d017cbca-28c2-4d75-bd72-f954bb545389', 'f2bde149-c2be-4704-b97e-914c101da1b8', '2b50cdea-f462-4d54-b44d-c085d424bc88', '216aa403-c4f8-4b4b-af96-3d838a034047'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:29:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:27 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:29:27 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:27 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.257s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:27 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:29:27 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Deleted volume successfully. Jul 14 21:29:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-39399046-1786-480d-8663-6d1caa8599c7 tempest-VolumeAndVolumeTypeFromImageTest-889457086 None] Lock "cinder-5c5c275d-7fbf-4591-a042-42f03779ee38-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:33 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-39de526c-8e51-4dd7-8c5c-2772d5d13fac tempest-TestShelveInstance-1861996334 None] Terminate volume connection completed successfully. Jul 14 21:29:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-39de526c-8e51-4dd7-8c5c-2772d5d13fac tempest-TestShelveInstance-1861996334 None] Deleting attachment 81ac5718-16d4-4be8-8e40-c6f2af1ef2fc. {{(pid=88300) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 14 21:29:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Acquiring lock "cinder-f062281a-03b9-41d2-af02-bfe533e82d81-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Lock "cinder-f062281a-03b9-41d2-af02-bfe533e82d81-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Acquiring lock "cinder-quobyte-f062281a-03b9-41d2-af02-bfe533e82d81" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Lock "cinder-quobyte-f062281a-03b9-41d2-af02-bfe533e82d81" acquired by "delete_volume" :: waited 0.022s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:33 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7d0f71-cdb2-4848-b86a-6ff5bd557fd3]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:33 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 Jul 14 21:29:33 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:33 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81" returned: 0 in 0.424s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:33 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 Jul 14 21:29:33 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:29:33 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Flow 'volume_create_manager' (dfc87101-b1de-472f-876b-182a10929e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267068fc-6233-4330-915b-c65471f10a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267068fc-6233-4330-915b-c65471f10a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-931359224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5585f12a-898d-49e3-8e96-d30d3fb10493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130c6f25291f4df09972ab2266745a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:34Z,use_quota=True,user_id='1f38f18e41f74d01afaad3b59a069f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cdd1e2-f243-4a0f-b983-66d8c0ba2319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cdd1e2-f243-4a0f-b983-66d8c0ba2319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c286f369-365f-4a8d-81aa-676063357c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c286f369-365f-4a8d-81aa-676063357c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5585f12a-898d-49e3-8e96-d30d3fb10493', 'volume_name': 'volume-5585f12a-898d-49e3-8e96-d30d3fb10493', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbcf8aa2-1a02-4379-a5b8-89ea5985bdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbcf8aa2-1a02-4379-a5b8-89ea5985bdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ebf95e-b370-44d3-b605-ac262bbb92cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:34 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Volume 5585f12a-898d-49e3-8e96-d30d3fb10493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5585f12a-898d-49e3-8e96-d30d3fb10493', 'volume_size': 1} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-931359224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5585f12a-898d-49e3-8e96-d30d3fb10493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130c6f25291f4df09972ab2266745a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:34Z,use_quota=True,user_id='1f38f18e41f74d01afaad3b59a069f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Creating volume 5585f12a-898d-49e3-8e96-d30d3fb10493 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:29:34 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5585f12a-898d-49e3-8e96-d30d3fb10493 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:34 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5585f12a-898d-49e3-8e96-d30d3fb10493 1073741824 Jul 14 21:29:34 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:34 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81" returned: 1 in 0.487s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:34 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81 Jul 14 21:29:34 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Flow 'volume_create_manager' (eca00d5e-6f8c-4be5-a8ea-eb7162ca46b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e57360-8160-4ee0-a35a-69983fdd77d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e57360-8160-4ee0-a35a-69983fdd77d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-820412584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794180c5-0436-4167-9bdb-06b10ccb633e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130c6f25291f4df09972ab2266745a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:34Z,use_quota=True,user_id='1f38f18e41f74d01afaad3b59a069f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05951c6-7de9-4b20-b5d0-de47b67a7864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05951c6-7de9-4b20-b5d0-de47b67a7864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4aa3d8-0406-40c6-84cb-4b07366f46e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4aa3d8-0406-40c6-84cb-4b07366f46e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '794180c5-0436-4167-9bdb-06b10ccb633e', 'volume_name': 'volume-794180c5-0436-4167-9bdb-06b10ccb633e', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3808fdf-803d-4cd0-b84e-7f06f62f6b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3808fdf-803d-4cd0-b84e-7f06f62f6b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e451a555-3d3f-4026-81d2-cffc72993d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:34 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Volume 794180c5-0436-4167-9bdb-06b10ccb633e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-794180c5-0436-4167-9bdb-06b10ccb633e', 'volume_size': 1} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:34 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f062281a-03b9-41d2-af02-bfe533e82d81" returned: 0 in 0.450s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:34 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5585f12a-898d-49e3-8e96-d30d3fb10493 1073741824" returned: 0 in 0.659s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Lock "cinder-quobyte-f062281a-03b9-41d2-af02-bfe533e82d81" released by "delete_volume" :: held 1.451s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5585f12a-898d-49e3-8e96-d30d3fb10493 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:34 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5585f12a-898d-49e3-8e96-d30d3fb10493 Jul 14 21:29:34 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Flow 'volume_create_manager' (bfc2b86d-9503-41c2-83d4-b20996a9cee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e69d3d7-19b4-4f66-b77f-dc8cd9915073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.quota [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Created reservations ['f032cf01-374f-4577-bfa1-c43ee1e66db5', 'f0af2dc0-6084-470c-8ed0-307a880d4c04', 'd6dde577-2617-47d0-9f67-f46b351a3bd2', '4b68cd7f-eb29-4537-b455-0d7f7ec7b3ad'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e69d3d7-19b4-4f66-b77f-dc8cd9915073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-146467276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a8566a-5de5-4d4d-ac54-82a30f031df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130c6f25291f4df09972ab2266745a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:35Z,use_quota=True,user_id='1f38f18e41f74d01afaad3b59a069f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b7d5e8-9635-43a8-a57a-d3a4f9b59772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b7d5e8-9635-43a8-a57a-d3a4f9b59772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d52ad2a-3c76-462a-95c6-e625e8187369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d52ad2a-3c76-462a-95c6-e625e8187369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48a8566a-5de5-4d4d-ac54-82a30f031df1', 'volume_name': 'volume-48a8566a-5de5-4d4d-ac54-82a30f031df1', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48963a47-1206-48c4-8174-6431f0ce3029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48963a47-1206-48c4-8174-6431f0ce3029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c188ca-19cc-4b09-8f29-f1e2ec1e3459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:34 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Volume 48a8566a-5de5-4d4d-ac54-82a30f031df1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48a8566a-5de5-4d4d-ac54-82a30f031df1', 'volume_size': 1} Jul 14 21:29:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:35 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:29:35 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:29:35 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Flow 'volume_create_manager' (38870269-7310-4e6a-87d1-9eaf1074941e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf34a2f-0c9f-45f5-9b61-44d78748f947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5585f12a-898d-49e3-8e96-d30d3fb10493" returned: 0 in 0.585s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.738s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-820412584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794180c5-0436-4167-9bdb-06b10ccb633e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130c6f25291f4df09972ab2266745a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:34Z,use_quota=True,user_id='1f38f18e41f74d01afaad3b59a069f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Creating volume 794180c5-0436-4167-9bdb-06b10ccb633e {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:29:35 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-794180c5-0436-4167-9bdb-06b10ccb633e 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:35 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf34a2f-0c9f-45f5-9b61-44d78748f947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-55580106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0abf0217-c53a-4696-9f4c-7dcdf5aa42e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130c6f25291f4df09972ab2266745a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:35Z,use_quota=True,user_id='1f38f18e41f74d01afaad3b59a069f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:35 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-794180c5-0436-4167-9bdb-06b10ccb633e 1073741824 Jul 14 21:29:35 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744ba14b-10ba-4363-b8eb-a506bbe28abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744ba14b-10ba-4363-b8eb-a506bbe28abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60049a6-7eef-4ecb-9b1e-556b86007527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60049a6-7eef-4ecb-9b1e-556b86007527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0abf0217-c53a-4696-9f4c-7dcdf5aa42e3', 'volume_name': 'volume-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423ab0e4-7e94-4c7a-b127-9d54bc0e06f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423ab0e4-7e94-4c7a-b127-9d54bc0e06f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937de8d6-2fbf-4de2-be68-1d78abc4e615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:35 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Volume 0abf0217-c53a-4696-9f4c-7dcdf5aa42e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3', 'volume_size': 1} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.422s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.manager [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ebf95e-b370-44d3-b605-ac262bbb92cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5585f12a-898d-49e3-8e96-d30d3fb10493', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1701b09-122e-4acd-a260-b592338a938a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:35 devstack cinder-volume[88300]: INFO cinder.volume.manager [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Deleted volume successfully. Jul 14 21:29:35 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Volume volume-5585f12a-898d-49e3-8e96-d30d3fb10493 (5585f12a-898d-49e3-8e96-d30d3fb10493): created successfully Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1701b09-122e-4acd-a260-b592338a938a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Flow 'volume_create_manager' (dfc87101-b1de-472f-876b-182a10929e85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [req-5a7c50d6-bc16-4881-89aa-09509a69d6a2 req-d19b73a5-7564-48fc-88d7-2b282070077c tempest-TestShelveInstance-1861996334 None] Lock "cinder-f062281a-03b9-41d2-af02-bfe533e82d81-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:35 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-99e4b5cf-53ac-4f47-a081-5bf8693da807 tempest-CreateVolumesFromImageTest-1758765660 None] Created volume successfully. Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Flow 'volume_create_manager' (1ae8a8fb-65cb-4ea5-9aed-165610019d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cf3ef8-741e-464a-8fad-bdf9a544e921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cf3ef8-741e-464a-8fad-bdf9a544e921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2059025756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958562bf-a6fc-4578-a052-54de551f2b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130c6f25291f4df09972ab2266745a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:36Z,use_quota=True,user_id='1f38f18e41f74d01afaad3b59a069f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744313ae-9355-4b29-a795-a00801595623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744313ae-9355-4b29-a795-a00801595623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f39dc38-05ac-47aa-8ee7-fa57e2a8188e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f39dc38-05ac-47aa-8ee7-fa57e2a8188e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '958562bf-a6fc-4578-a052-54de551f2b9f', 'volume_name': 'volume-958562bf-a6fc-4578-a052-54de551f2b9f', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b4c991-562c-4000-b8ec-b4ccce99f34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b4c991-562c-4000-b8ec-b4ccce99f34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3633d9f-3396-4992-ac5a-0693d6e051d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:35 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Volume 958562bf-a6fc-4578-a052-54de551f2b9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-958562bf-a6fc-4578-a052-54de551f2b9f', 'volume_size': 1} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:35 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-794180c5-0436-4167-9bdb-06b10ccb633e 1073741824" returned: 0 in 0.529s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-794180c5-0436-4167-9bdb-06b10ccb633e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:35 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-794180c5-0436-4167-9bdb-06b10ccb633e Jul 14 21:29:35 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:36 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-794180c5-0436-4167-9bdb-06b10ccb633e" returned: 0 in 0.256s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.241s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-146467276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a8566a-5de5-4d4d-ac54-82a30f031df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130c6f25291f4df09972ab2266745a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:35Z,use_quota=True,user_id='1f38f18e41f74d01afaad3b59a069f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Creating volume 48a8566a-5de5-4d4d-ac54-82a30f031df1 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:29:36 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48a8566a-5de5-4d4d-ac54-82a30f031df1 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e451a555-3d3f-4026-81d2-cffc72993d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794180c5-0436-4167-9bdb-06b10ccb633e', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:36 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48a8566a-5de5-4d4d-ac54-82a30f031df1 1073741824 Jul 14 21:29:36 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af1dee2-85ac-4410-866e-3833b878286f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:36 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Volume volume-794180c5-0436-4167-9bdb-06b10ccb633e (794180c5-0436-4167-9bdb-06b10ccb633e): created successfully Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af1dee2-85ac-4410-866e-3833b878286f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Flow 'volume_create_manager' (eca00d5e-6f8c-4be5-a8ea-eb7162ca46b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:36 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-784ae0aa-27ca-47fc-a296-3398d236bca9 tempest-CreateVolumesFromImageTest-1758765660 None] Created volume successfully. Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:36 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:29:36 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:36 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48a8566a-5de5-4d4d-ac54-82a30f031df1 1073741824" returned: 0 in 0.518s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48a8566a-5de5-4d4d-ac54-82a30f031df1 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:36 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48a8566a-5de5-4d4d-ac54-82a30f031df1 Jul 14 21:29:36 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:36 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.351s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 28 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:29:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:29:37 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48a8566a-5de5-4d4d-ac54-82a30f031df1" returned: 0 in 0.260s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.577s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-55580106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0abf0217-c53a-4696-9f4c-7dcdf5aa42e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130c6f25291f4df09972ab2266745a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:35Z,use_quota=True,user_id='1f38f18e41f74d01afaad3b59a069f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Creating volume 0abf0217-c53a-4696-9f4c-7dcdf5aa42e3 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:29:37 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c188ca-19cc-4b09-8f29-f1e2ec1e3459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a8566a-5de5-4d4d-ac54-82a30f031df1', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:37 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3 1073741824 Jul 14 21:29:37 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d4290c-e73c-4df4-890a-c84378a8ec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:37 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Volume volume-48a8566a-5de5-4d4d-ac54-82a30f031df1 (48a8566a-5de5-4d4d-ac54-82a30f031df1): created successfully Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d4290c-e73c-4df4-890a-c84378a8ec90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Flow 'volume_create_manager' (bfc2b86d-9503-41c2-83d4-b20996a9cee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:37 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2a9d22c1-9e9d-4cee-897d-91207d5122b5 tempest-CreateVolumesFromImageTest-1758765660 None] Created volume successfully. Jul 14 21:29:37 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3 1073741824" returned: 0 in 0.433s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:37 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3 Jul 14 21:29:37 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:37 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3" returned: 0 in 0.289s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.994s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2059025756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958562bf-a6fc-4578-a052-54de551f2b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130c6f25291f4df09972ab2266745a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:36Z,use_quota=True,user_id='1f38f18e41f74d01afaad3b59a069f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Creating volume 958562bf-a6fc-4578-a052-54de551f2b9f {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:29:37 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-958562bf-a6fc-4578-a052-54de551f2b9f 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937de8d6-2fbf-4de2-be68-1d78abc4e615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:37 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-958562bf-a6fc-4578-a052-54de551f2b9f 1073741824 Jul 14 21:29:37 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb85a010-ccb5-4f86-8399-98d66c933193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:37 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Volume volume-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3 (0abf0217-c53a-4696-9f4c-7dcdf5aa42e3): created successfully Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb85a010-ccb5-4f86-8399-98d66c933193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Flow 'volume_create_manager' (38870269-7310-4e6a-87d1-9eaf1074941e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:37 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-71066cb7-29a5-490c-8f68-d6a7a3730daa tempest-CreateVolumesFromImageTest-1758765660 None] Created volume successfully. Jul 14 21:29:38 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-958562bf-a6fc-4578-a052-54de551f2b9f 1073741824" returned: 0 in 0.591s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-958562bf-a6fc-4578-a052-54de551f2b9f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:38 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-958562bf-a6fc-4578-a052-54de551f2b9f Jul 14 21:29:38 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:38 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-958562bf-a6fc-4578-a052-54de551f2b9f" returned: 0 in 0.312s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:29:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3633d9f-3396-4992-ac5a-0693d6e051d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-958562bf-a6fc-4578-a052-54de551f2b9f', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a1a3ad-9bf5-4ebe-9e10-069981eaa9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:38 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Volume volume-958562bf-a6fc-4578-a052-54de551f2b9f (958562bf-a6fc-4578-a052-54de551f2b9f): created successfully Jul 14 21:29:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a1a3ad-9bf5-4ebe-9e10-069981eaa9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:38 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Flow 'volume_create_manager' (1ae8a8fb-65cb-4ea5-9aed-165610019d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:38 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e364bcb7-f991-4c5d-84c6-b7af55e6097b tempest-CreateVolumesFromImageTest-1758765660 None] Created volume successfully. Jul 14 21:29:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "cinder-958562bf-a6fc-4578-a052-54de551f2b9f-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-958562bf-a6fc-4578-a052-54de551f2b9f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "cinder-quobyte-958562bf-a6fc-4578-a052-54de551f2b9f" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-quobyte-958562bf-a6fc-4578-a052-54de551f2b9f" acquired by "delete_volume" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:39 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[568f46b2-08a6-470c-8b15-e114ea1d51b5]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-958562bf-a6fc-4578-a052-54de551f2b9f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:39 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-958562bf-a6fc-4578-a052-54de551f2b9f Jul 14 21:29:39 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:39 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-958562bf-a6fc-4578-a052-54de551f2b9f" returned: 0 in 0.409s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-958562bf-a6fc-4578-a052-54de551f2b9f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:39 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-958562bf-a6fc-4578-a052-54de551f2b9f Jul 14 21:29:39 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:39 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-958562bf-a6fc-4578-a052-54de551f2b9f" returned: 0 in 0.248s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-quobyte-958562bf-a6fc-4578-a052-54de551f2b9f" released by "delete_volume" :: held 0.704s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:39 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] Created reservations ['f75551f7-1467-413c-baa8-f59470fabe4f', 'e0ae4314-181e-4de6-9972-2954052e461a', 'ab0b5811-d8de-4f18-9183-bd9cab8034e2', '26703705-cddf-4835-a092-59c8e11cd22e'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:29:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:40 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:40 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:40 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:29:40 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "cinder-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:40 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.277s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:40 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:29:40 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] Deleted volume successfully. Jul 14 21:29:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "cinder-quobyte-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-981bf5e2-7772-40e4-99d9-6e964f14e0cd tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-958562bf-a6fc-4578-a052-54de551f2b9f-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-quobyte-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3" acquired by "delete_volume" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:40 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6db2cb-95bd-442a-9c5e-6fb26c349373]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:40 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3 Jul 14 21:29:40 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:40 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3" returned: 0 in 0.412s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:40 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3 Jul 14 21:29:40 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:41 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3" returned: 0 in 0.240s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-quobyte-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3" released by "delete_volume" :: held 0.691s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] Created reservations ['b0737120-ca2c-43e9-9775-5ce171ca0d75', 'e615970c-6071-46fa-8361-5e3dcb08c365', '499f0417-6236-4f3b-8850-cbbaa5cb0865', 'f70d8e11-d04d-47ac-9bbd-47db0bedbffa'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:41 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:29:41 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:41 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.263s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:29:41 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] Deleted volume successfully. Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "cinder-48a8566a-5de5-4d4d-ac54-82a30f031df1-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-99eea235-b318-4ce2-b7d3-0ac67e9cfac7 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-0abf0217-c53a-4696-9f4c-7dcdf5aa42e3-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-48a8566a-5de5-4d4d-ac54-82a30f031df1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "cinder-quobyte-48a8566a-5de5-4d4d-ac54-82a30f031df1" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-quobyte-48a8566a-5de5-4d4d-ac54-82a30f031df1" acquired by "delete_volume" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d606a7-f956-4a5e-b762-d8fba9fb04e3]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48a8566a-5de5-4d4d-ac54-82a30f031df1 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:41 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48a8566a-5de5-4d4d-ac54-82a30f031df1 Jul 14 21:29:41 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:42 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48a8566a-5de5-4d4d-ac54-82a30f031df1" returned: 0 in 0.419s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48a8566a-5de5-4d4d-ac54-82a30f031df1 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:42 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48a8566a-5de5-4d4d-ac54-82a30f031df1 Jul 14 21:29:42 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:42 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-48a8566a-5de5-4d4d-ac54-82a30f031df1" returned: 0 in 0.259s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-quobyte-48a8566a-5de5-4d4d-ac54-82a30f031df1" released by "delete_volume" :: held 0.723s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] Created reservations ['1bcbaedc-2660-4d01-8eda-b10154d9e823', '0faf98c8-bd64-4bb1-ae42-6d38680ff284', 'ba03ba24-b797-4530-8c2f-240fc191bf44', '737fae8d-9557-49fd-858c-cfca533bb5d3'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:42 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:29:42 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:42 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "cinder-794180c5-0436-4167-9bdb-06b10ccb633e-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.302s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:29:42 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] Deleted volume successfully. Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-794180c5-0436-4167-9bdb-06b10ccb633e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-772e2a35-401d-49c1-aeb1-45988663e030 tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-48a8566a-5de5-4d4d-ac54-82a30f031df1-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "cinder-quobyte-794180c5-0436-4167-9bdb-06b10ccb633e" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-quobyte-794180c5-0436-4167-9bdb-06b10ccb633e" acquired by "delete_volume" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b236c9c-9425-45d0-b1a9-60dd8bba4c8d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-794180c5-0436-4167-9bdb-06b10ccb633e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:42 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-794180c5-0436-4167-9bdb-06b10ccb633e Jul 14 21:29:42 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:43 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-794180c5-0436-4167-9bdb-06b10ccb633e" returned: 0 in 0.360s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-794180c5-0436-4167-9bdb-06b10ccb633e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:43 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-794180c5-0436-4167-9bdb-06b10ccb633e Jul 14 21:29:43 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:43 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-794180c5-0436-4167-9bdb-06b10ccb633e" returned: 0 in 0.236s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-quobyte-794180c5-0436-4167-9bdb-06b10ccb633e" released by "delete_volume" :: held 0.662s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] Created reservations ['33de9dbc-714e-42b1-99fb-64f6d0dd051e', '2f0332c0-09d2-406f-a7d9-6ee7f1c49a36', '82ad7879-4228-495b-8796-5c31337d966d', '753ee9ef-f210-4444-a43c-767f98065ed7'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:43 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:29:43 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:43 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.270s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:29:43 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] Deleted volume successfully. Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dfd4e1db-66ae-43d6-b198-655f3b315ffb tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-794180c5-0436-4167-9bdb-06b10ccb633e-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "cinder-5585f12a-898d-49e3-8e96-d30d3fb10493-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-5585f12a-898d-49e3-8e96-d30d3fb10493-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "cinder-quobyte-5585f12a-898d-49e3-8e96-d30d3fb10493" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:43 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-quobyte-5585f12a-898d-49e3-8e96-d30d3fb10493" acquired by "delete_volume" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:44 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[73062c5d-722c-4c2f-a19d-2e9aee38483c]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5585f12a-898d-49e3-8e96-d30d3fb10493 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:44 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5585f12a-898d-49e3-8e96-d30d3fb10493 Jul 14 21:29:44 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:44 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5585f12a-898d-49e3-8e96-d30d3fb10493" returned: 0 in 0.369s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5585f12a-898d-49e3-8e96-d30d3fb10493 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:44 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5585f12a-898d-49e3-8e96-d30d3fb10493 Jul 14 21:29:44 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:44 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-5585f12a-898d-49e3-8e96-d30d3fb10493" returned: 0 in 0.283s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-quobyte-5585f12a-898d-49e3-8e96-d30d3fb10493" released by "delete_volume" :: held 0.710s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:44 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] Created reservations ['497522ae-8839-4f13-8188-2e3249065ccb', '73cfc875-6581-43f6-adf3-0e8587c411d7', 'd40f459e-cccf-42e0-a5a6-91b5a61d2045', '8f6d582f-734c-4db8-89b6-b2c614a1db9c'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:29:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:44 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:29:44 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:45 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.267s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:45 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:29:45 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] Deleted volume successfully. Jul 14 21:29:45 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2e8d4dd4-3438-4a4e-8a42-aedd4f20bffa tempest-CreateVolumesFromImageTest-1758765660 None] Lock "cinder-5585f12a-898d-49e3-8e96-d30d3fb10493-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Flow 'volume_create_manager' (d79bf8a7-c29c-45c5-a182-3e8bf28b9438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5e3118-9f5f-4ff9-8d71-40b7aab0639c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5e3118-9f5f-4ff9-8d71-40b7aab0639c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-582540701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aeda307-8f15-45a5-8c87-e99811878b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35833f3cdb114028be3df98884f32fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:48Z,use_quota=True,user_id='2feb7c2ef5364d1f9c550630911a8c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af43688-e013-4070-b674-d9469fa950ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af43688-e013-4070-b674-d9469fa950ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c869d27-2567-47fb-8239-82a0173ec198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c869d27-2567-47fb-8239-82a0173ec198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aeda307-8f15-45a5-8c87-e99811878b7b', 'volume_name': 'volume-1aeda307-8f15-45a5-8c87-e99811878b7b', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99cde008-6bb0-47e4-8014-b14d0f15209b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99cde008-6bb0-47e4-8014-b14d0f15209b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7e0184-b70f-4163-92f2-8e8996731e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:47 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume 1aeda307-8f15-45a5-8c87-e99811878b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aeda307-8f15-45a5-8c87-e99811878b7b', 'volume_size': 1} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-582540701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aeda307-8f15-45a5-8c87-e99811878b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35833f3cdb114028be3df98884f32fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:48Z,use_quota=True,user_id='2feb7c2ef5364d1f9c550630911a8c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Creating volume 1aeda307-8f15-45a5-8c87-e99811878b7b {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:29:47 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:29:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1aeda307-8f15-45a5-8c87-e99811878b7b 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:47 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1aeda307-8f15-45a5-8c87-e99811878b7b 1073741824 Jul 14 21:29:47 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:48 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1aeda307-8f15-45a5-8c87-e99811878b7b 1073741824" returned: 0 in 0.406s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1aeda307-8f15-45a5-8c87-e99811878b7b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:48 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1aeda307-8f15-45a5-8c87-e99811878b7b Jul 14 21:29:48 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:48 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1aeda307-8f15-45a5-8c87-e99811878b7b" returned: 0 in 0.244s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:29:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:48 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7e0184-b70f-4163-92f2-8e8996731e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aeda307-8f15-45a5-8c87-e99811878b7b', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:48 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a421d6a2-b204-4018-937a-aa75bd619744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:48 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume volume-1aeda307-8f15-45a5-8c87-e99811878b7b (1aeda307-8f15-45a5-8c87-e99811878b7b): created successfully Jul 14 21:29:48 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a421d6a2-b204-4018-937a-aa75bd619744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:48 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Flow 'volume_create_manager' (d79bf8a7-c29c-45c5-a182-3e8bf28b9438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:48 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a50097d5-1c84-4bcc-bcfd-18e82af61c17 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Created volume successfully. Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Flow 'volume_create_manager' (7222c81f-e287-4006-8f74-d731ac920f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36173b5d-c89a-4fdd-9896-d58fbd1d8e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36173b5d-c89a-4fdd-9896-d58fbd1d8e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1721745845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fcd7e7-ba28-431f-9691-5a95c657d1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35833f3cdb114028be3df98884f32fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:49Z,use_quota=True,user_id='2feb7c2ef5364d1f9c550630911a8c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951ef676-a52a-4e81-b818-1acc30744744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951ef676-a52a-4e81-b818-1acc30744744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f0dd60-bc3e-4ca8-891f-8398cc299792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f0dd60-bc3e-4ca8-891f-8398cc299792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8fcd7e7-ba28-431f-9691-5a95c657d1a9', 'volume_name': 'volume-e8fcd7e7-ba28-431f-9691-5a95c657d1a9', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce750a6e-5fb4-45a5-9588-a4af58e76a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce750a6e-5fb4-45a5-9588-a4af58e76a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52886d4-72d2-4490-8ab1-945b9528e748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:49 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume e8fcd7e7-ba28-431f-9691-5a95c657d1a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8fcd7e7-ba28-431f-9691-5a95c657d1a9', 'volume_size': 1} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1721745845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fcd7e7-ba28-431f-9691-5a95c657d1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35833f3cdb114028be3df98884f32fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:49Z,use_quota=True,user_id='2feb7c2ef5364d1f9c550630911a8c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Creating volume e8fcd7e7-ba28-431f-9691-5a95c657d1a9 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:29:49 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e8fcd7e7-ba28-431f-9691-5a95c657d1a9 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:49 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e8fcd7e7-ba28-431f-9691-5a95c657d1a9 1073741824 Jul 14 21:29:49 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Flow 'volume_create_manager' (46e233c0-023b-421a-a7ab-6565ba8f7580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74ef108-a0ee-4466-8c8a-b96a6b9e00a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74ef108-a0ee-4466-8c8a-b96a6b9e00a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-507245215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50008300-d8f9-4323-8a63-d6c2005b4395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35833f3cdb114028be3df98884f32fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:49Z,use_quota=True,user_id='2feb7c2ef5364d1f9c550630911a8c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92673e2c-b490-4271-bb72-420340a0238d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92673e2c-b490-4271-bb72-420340a0238d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2219eee-d159-4414-ad85-9c2306bc7583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2219eee-d159-4414-ad85-9c2306bc7583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50008300-d8f9-4323-8a63-d6c2005b4395', 'volume_name': 'volume-50008300-d8f9-4323-8a63-d6c2005b4395', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0751a423-7eca-40e9-8009-08d974532260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0751a423-7eca-40e9-8009-08d974532260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea40ada-013e-49e6-9fb7-74900c051679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:49 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume 50008300-d8f9-4323-8a63-d6c2005b4395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50008300-d8f9-4323-8a63-d6c2005b4395', 'volume_size': 1} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:49 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e8fcd7e7-ba28-431f-9691-5a95c657d1a9 1073741824" returned: 0 in 0.491s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e8fcd7e7-ba28-431f-9691-5a95c657d1a9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:49 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e8fcd7e7-ba28-431f-9691-5a95c657d1a9 Jul 14 21:29:49 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Flow 'volume_create_manager' (906aa553-a7b2-4dc9-bbc1-7df0af30b955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b8a8d0-87f6-4300-8d62-e1c197ddb2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b8a8d0-87f6-4300-8d62-e1c197ddb2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-831752241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a2934c-df32-41f3-a995-795cd7f539de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35833f3cdb114028be3df98884f32fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:50Z,use_quota=True,user_id='2feb7c2ef5364d1f9c550630911a8c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49da0c1f-735c-4ff1-a139-872cc4927f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49da0c1f-735c-4ff1-a139-872cc4927f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b346b06-6d08-4d23-8869-296a4b5ae242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b346b06-6d08-4d23-8869-296a4b5ae242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5a2934c-df32-41f3-a995-795cd7f539de', 'volume_name': 'volume-c5a2934c-df32-41f3-a995-795cd7f539de', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e549052-3279-4e3b-948c-fe46bc3fa026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e549052-3279-4e3b-948c-fe46bc3fa026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6249141e-ee00-407e-82e5-3089fa622d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:50 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume c5a2934c-df32-41f3-a995-795cd7f539de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5a2934c-df32-41f3-a995-795cd7f539de', 'volume_size': 1} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:50 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e8fcd7e7-ba28-431f-9691-5a95c657d1a9" returned: 0 in 0.273s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.445s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-507245215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50008300-d8f9-4323-8a63-d6c2005b4395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35833f3cdb114028be3df98884f32fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:49Z,use_quota=True,user_id='2feb7c2ef5364d1f9c550630911a8c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Creating volume 50008300-d8f9-4323-8a63-d6c2005b4395 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:29:50 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-50008300-d8f9-4323-8a63-d6c2005b4395 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52886d4-72d2-4490-8ab1-945b9528e748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8fcd7e7-ba28-431f-9691-5a95c657d1a9', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:50 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-50008300-d8f9-4323-8a63-d6c2005b4395 1073741824 Jul 14 21:29:50 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4418f3a0-3f6c-427e-a75e-edfa3679e2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:50 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume volume-e8fcd7e7-ba28-431f-9691-5a95c657d1a9 (e8fcd7e7-ba28-431f-9691-5a95c657d1a9): created successfully Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4418f3a0-3f6c-427e-a75e-edfa3679e2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Flow 'volume_create_manager' (7222c81f-e287-4006-8f74-d731ac920f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:50 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d349cf57-aec9-456c-a358-307f7caa8163 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Created volume successfully. Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Flow 'volume_create_manager' (75a71b4c-e4cb-44d4-9342-3d3fefe7582a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5636c472-f1bd-4e0a-b62c-e8cb95f14ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5636c472-f1bd-4e0a-b62c-e8cb95f14ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1063419836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ed02a4-f54c-45e4-8315-93520a0816c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35833f3cdb114028be3df98884f32fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:50Z,use_quota=True,user_id='2feb7c2ef5364d1f9c550630911a8c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c3dc15-52d6-4dc6-8bad-c6f2447301d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c3dc15-52d6-4dc6-8bad-c6f2447301d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d882030-7722-4c9c-95c5-455ee1858763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d882030-7722-4c9c-95c5-455ee1858763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7ed02a4-f54c-45e4-8315-93520a0816c9', 'volume_name': 'volume-e7ed02a4-f54c-45e4-8315-93520a0816c9', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe79122-156a-4ebe-9ec6-0ceb4f1eb821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe79122-156a-4ebe-9ec6-0ceb4f1eb821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd41add-df92-4be8-9528-4b5f1908670d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:50 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume e7ed02a4-f54c-45e4-8315-93520a0816c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7ed02a4-f54c-45e4-8315-93520a0816c9', 'volume_size': 1} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:50 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-50008300-d8f9-4323-8a63-d6c2005b4395 1073741824" returned: 0 in 0.528s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Flow 'volume_create_manager' (fe454c5e-e064-42be-9bd8-2dedc1f56766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f8fd5a-ed48-4247-9c9e-a25937e70f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-50008300-d8f9-4323-8a63-d6c2005b4395 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f8fd5a-ed48-4247-9c9e-a25937e70f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2114360618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b6d7ae-0057-453e-acc1-6a55daf2a0a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35833f3cdb114028be3df98884f32fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:51Z,use_quota=True,user_id='2feb7c2ef5364d1f9c550630911a8c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ee9016-33a8-46d6-9f16-89102cbb35b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:50 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-50008300-d8f9-4323-8a63-d6c2005b4395 Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ee9016-33a8-46d6-9f16-89102cbb35b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:50 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4683b40c-175b-4557-a5a7-f2d9ebdacdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4683b40c-175b-4557-a5a7-f2d9ebdacdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b6d7ae-0057-453e-acc1-6a55daf2a0a3', 'volume_name': 'volume-05b6d7ae-0057-453e-acc1-6a55daf2a0a3', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (decddd3f-8599-4691-acd8-bc5ab6efc253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (decddd3f-8599-4691-acd8-bc5ab6efc253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b68bd8-e6e2-40cb-aa2d-cd17fb104b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:50 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume 05b6d7ae-0057-453e-acc1-6a55daf2a0a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b6d7ae-0057-453e-acc1-6a55daf2a0a3', 'volume_size': 1} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:50 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-50008300-d8f9-4323-8a63-d6c2005b4395" returned: 0 in 0.261s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.949s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-831752241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a2934c-df32-41f3-a995-795cd7f539de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35833f3cdb114028be3df98884f32fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:50Z,use_quota=True,user_id='2feb7c2ef5364d1f9c550630911a8c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Creating volume c5a2934c-df32-41f3-a995-795cd7f539de {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:29:50 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c5a2934c-df32-41f3-a995-795cd7f539de 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea40ada-013e-49e6-9fb7-74900c051679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50008300-d8f9-4323-8a63-d6c2005b4395', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:50 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c5a2934c-df32-41f3-a995-795cd7f539de 1073741824 Jul 14 21:29:50 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b2636d6-b495-4465-b3bd-3357ca553521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:51 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume volume-50008300-d8f9-4323-8a63-d6c2005b4395 (50008300-d8f9-4323-8a63-d6c2005b4395): created successfully Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b2636d6-b495-4465-b3bd-3357ca553521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Flow 'volume_create_manager' (46e233c0-023b-421a-a7ab-6565ba8f7580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:51 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-666b28c6-a799-4964-b1cd-0389949197c1 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Created volume successfully. Jul 14 21:29:51 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c5a2934c-df32-41f3-a995-795cd7f539de 1073741824" returned: 0 in 0.408s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c5a2934c-df32-41f3-a995-795cd7f539de {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:51 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c5a2934c-df32-41f3-a995-795cd7f539de Jul 14 21:29:51 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:51 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c5a2934c-df32-41f3-a995-795cd7f539de" returned: 0 in 0.242s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.300s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1063419836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ed02a4-f54c-45e4-8315-93520a0816c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35833f3cdb114028be3df98884f32fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:50Z,use_quota=True,user_id='2feb7c2ef5364d1f9c550630911a8c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Creating volume e7ed02a4-f54c-45e4-8315-93520a0816c9 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:29:51 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7ed02a4-f54c-45e4-8315-93520a0816c9 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:51 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7ed02a4-f54c-45e4-8315-93520a0816c9 1073741824 Jul 14 21:29:51 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6249141e-ee00-407e-82e5-3089fa622d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5a2934c-df32-41f3-a995-795cd7f539de', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192c0b5d-22bb-40c0-95da-77153c4d9a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:51 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume volume-c5a2934c-df32-41f3-a995-795cd7f539de (c5a2934c-df32-41f3-a995-795cd7f539de): created successfully Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192c0b5d-22bb-40c0-95da-77153c4d9a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Flow 'volume_create_manager' (906aa553-a7b2-4dc9-bbc1-7df0af30b955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:51 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-92f4e0d5-5af6-47c3-884a-3b5df4180461 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Created volume successfully. Jul 14 21:29:52 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7ed02a4-f54c-45e4-8315-93520a0816c9 1073741824" returned: 0 in 0.395s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7ed02a4-f54c-45e4-8315-93520a0816c9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:52 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7ed02a4-f54c-45e4-8315-93520a0816c9 Jul 14 21:29:52 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:52 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7ed02a4-f54c-45e4-8315-93520a0816c9" returned: 0 in 0.235s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.578s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2114360618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b6d7ae-0057-453e-acc1-6a55daf2a0a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35833f3cdb114028be3df98884f32fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:29:51Z,use_quota=True,user_id='2feb7c2ef5364d1f9c550630911a8c2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Creating volume 05b6d7ae-0057-453e-acc1-6a55daf2a0a3 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:29:52 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-05b6d7ae-0057-453e-acc1-6a55daf2a0a3 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd41add-df92-4be8-9528-4b5f1908670d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7ed02a4-f54c-45e4-8315-93520a0816c9', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:52 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-05b6d7ae-0057-453e-acc1-6a55daf2a0a3 1073741824 Jul 14 21:29:52 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697573de-d557-4cce-a616-10ba5a71267e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:52 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume volume-e7ed02a4-f54c-45e4-8315-93520a0816c9 (e7ed02a4-f54c-45e4-8315-93520a0816c9): created successfully Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697573de-d557-4cce-a616-10ba5a71267e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Flow 'volume_create_manager' (75a71b4c-e4cb-44d4-9342-3d3fefe7582a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:52 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-9db4e3e8-9fc0-4d6c-a233-6caa52ebabb8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Created volume successfully. Jul 14 21:29:52 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-05b6d7ae-0057-453e-acc1-6a55daf2a0a3 1073741824" returned: 0 in 0.417s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-05b6d7ae-0057-453e-acc1-6a55daf2a0a3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:52 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-05b6d7ae-0057-453e-acc1-6a55daf2a0a3 Jul 14 21:29:52 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:53 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-05b6d7ae-0057-453e-acc1-6a55daf2a0a3" returned: 0 in 0.246s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:29:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b68bd8-e6e2-40cb-aa2d-cd17fb104b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b6d7ae-0057-453e-acc1-6a55daf2a0a3', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0904c10-ba63-4b94-b00d-6516bcef8974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:29:53 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Volume volume-05b6d7ae-0057-453e-acc1-6a55daf2a0a3 (05b6d7ae-0057-453e-acc1-6a55daf2a0a3): created successfully Jul 14 21:29:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0904c10-ba63-4b94-b00d-6516bcef8974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:29:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Flow 'volume_create_manager' (fe454c5e-e064-42be-9bd8-2dedc1f56766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:29:53 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-96c3185f-b177-402d-b509-a1fba70ea979 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Created volume successfully. Jul 14 21:29:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "cinder-05b6d7ae-0057-453e-acc1-6a55daf2a0a3-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-05b6d7ae-0057-453e-acc1-6a55daf2a0a3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "cinder-quobyte-05b6d7ae-0057-453e-acc1-6a55daf2a0a3" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-quobyte-05b6d7ae-0057-453e-acc1-6a55daf2a0a3" acquired by "delete_volume" :: waited 0.013s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:54 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0263d682-a2b3-45d5-8a3d-144a701f9dd9]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-05b6d7ae-0057-453e-acc1-6a55daf2a0a3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:54 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-05b6d7ae-0057-453e-acc1-6a55daf2a0a3 Jul 14 21:29:54 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:54 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-05b6d7ae-0057-453e-acc1-6a55daf2a0a3" returned: 0 in 0.345s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-05b6d7ae-0057-453e-acc1-6a55daf2a0a3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:54 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-05b6d7ae-0057-453e-acc1-6a55daf2a0a3 Jul 14 21:29:54 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:54 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-05b6d7ae-0057-453e-acc1-6a55daf2a0a3" returned: 0 in 0.248s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-quobyte-05b6d7ae-0057-453e-acc1-6a55daf2a0a3" released by "delete_volume" :: held 0.630s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:54 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Created reservations ['b67abc36-13bb-4191-85be-10d324c817d3', '3581fa54-00cd-43f9-b4e9-6ca981c20a00', '4083c1d3-05fb-476c-aac7-0db095d41b4b', '8ebe98c3-2dd6-4c1e-9196-9b74ef4b0e36'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:29:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:54 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:29:54 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:55 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.234s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:29:55 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Deleted volume successfully. Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-344ecf67-fd2e-43e2-990f-157fdeb08fe8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-05b6d7ae-0057-453e-acc1-6a55daf2a0a3-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "cinder-e7ed02a4-f54c-45e4-8315-93520a0816c9-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-e7ed02a4-f54c-45e4-8315-93520a0816c9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "cinder-quobyte-e7ed02a4-f54c-45e4-8315-93520a0816c9" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-quobyte-e7ed02a4-f54c-45e4-8315-93520a0816c9" acquired by "delete_volume" :: waited 0.016s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0b7a9c-4022-45ea-94ea-039c8ad83724]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7ed02a4-f54c-45e4-8315-93520a0816c9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:55 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7ed02a4-f54c-45e4-8315-93520a0816c9 Jul 14 21:29:55 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:55 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7ed02a4-f54c-45e4-8315-93520a0816c9" returned: 0 in 0.355s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7ed02a4-f54c-45e4-8315-93520a0816c9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:55 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7ed02a4-f54c-45e4-8315-93520a0816c9 Jul 14 21:29:55 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:55 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e7ed02a4-f54c-45e4-8315-93520a0816c9" returned: 0 in 0.238s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-quobyte-e7ed02a4-f54c-45e4-8315-93520a0816c9" released by "delete_volume" :: held 0.628s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Created reservations ['af717b14-1fa9-449c-bb15-9d7c7f430bf0', '0e6aca5e-2651-4e28-914b-445ba9b7b93b', '4d7088df-6e85-4a20-93e2-664771dc1ebf', '4e06078f-e112-427c-a90f-beb6bf77d483'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:55 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:29:55 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:56 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.240s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:56 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:29:56 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Deleted volume successfully. Jul 14 21:29:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cce53fb9-65ab-4f97-a939-0a951fddf70f tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-e7ed02a4-f54c-45e4-8315-93520a0816c9-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "cinder-c5a2934c-df32-41f3-a995-795cd7f539de-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-c5a2934c-df32-41f3-a995-795cd7f539de-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "cinder-quobyte-c5a2934c-df32-41f3-a995-795cd7f539de" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-quobyte-c5a2934c-df32-41f3-a995-795cd7f539de" acquired by "delete_volume" :: waited 0.013s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:56 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5455fe72-c1f7-4ebc-bb9b-1c1efda4b9db]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c5a2934c-df32-41f3-a995-795cd7f539de {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:56 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c5a2934c-df32-41f3-a995-795cd7f539de Jul 14 21:29:56 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:56 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c5a2934c-df32-41f3-a995-795cd7f539de" returned: 0 in 0.360s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c5a2934c-df32-41f3-a995-795cd7f539de {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:56 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c5a2934c-df32-41f3-a995-795cd7f539de Jul 14 21:29:56 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:56 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-c5a2934c-df32-41f3-a995-795cd7f539de" returned: 0 in 0.237s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-quobyte-c5a2934c-df32-41f3-a995-795cd7f539de" released by "delete_volume" :: held 0.639s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Created reservations ['7b8133e3-11e5-46f9-afc8-23380d1d9bdf', 'f8f03d04-db34-4324-82d7-0d4e3cb3f5d9', '6690c1cc-2c9c-4021-9e53-0b73afbd2774', 'eaf73d46-1019-435c-b3f2-a20d52aacdfd'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:57 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:29:57 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:57 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.247s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:29:57 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Deleted volume successfully. Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-495065f6-9f91-4a88-b87f-ef11092cc37b tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-c5a2934c-df32-41f3-a995-795cd7f539de-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "cinder-50008300-d8f9-4323-8a63-d6c2005b4395-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-50008300-d8f9-4323-8a63-d6c2005b4395-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "cinder-quobyte-50008300-d8f9-4323-8a63-d6c2005b4395" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-quobyte-50008300-d8f9-4323-8a63-d6c2005b4395" acquired by "delete_volume" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[01565eda-19cb-4c57-886c-185bdaae4d62]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-50008300-d8f9-4323-8a63-d6c2005b4395 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:57 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-50008300-d8f9-4323-8a63-d6c2005b4395 Jul 14 21:29:57 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:57 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-50008300-d8f9-4323-8a63-d6c2005b4395" returned: 0 in 0.347s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-50008300-d8f9-4323-8a63-d6c2005b4395 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:57 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-50008300-d8f9-4323-8a63-d6c2005b4395 Jul 14 21:29:57 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:58 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-50008300-d8f9-4323-8a63-d6c2005b4395" returned: 0 in 0.244s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-quobyte-50008300-d8f9-4323-8a63-d6c2005b4395" released by "delete_volume" :: held 0.627s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Created reservations ['580d01aa-5478-4ff0-8eb5-be4bff9fa4d7', '8af379dc-e67f-4e61-8a75-3bcc11ca898e', '1816b92f-a9d0-4957-aa52-ffc262d201a8', '12fd8bbf-a3f0-45c5-a79f-032b072f663c'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:58 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:29:58 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:58 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.238s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:29:58 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Deleted volume successfully. Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4cf4b595-4dcb-4cf6-8bcf-5a7f00449459 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-50008300-d8f9-4323-8a63-d6c2005b4395-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "cinder-e8fcd7e7-ba28-431f-9691-5a95c657d1a9-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-e8fcd7e7-ba28-431f-9691-5a95c657d1a9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "cinder-quobyte-e8fcd7e7-ba28-431f-9691-5a95c657d1a9" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-quobyte-e8fcd7e7-ba28-431f-9691-5a95c657d1a9" acquired by "delete_volume" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea97616d-35ae-4eec-9543-26584c39abb8]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e8fcd7e7-ba28-431f-9691-5a95c657d1a9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:58 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e8fcd7e7-ba28-431f-9691-5a95c657d1a9 Jul 14 21:29:58 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:59 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e8fcd7e7-ba28-431f-9691-5a95c657d1a9" returned: 0 in 0.355s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e8fcd7e7-ba28-431f-9691-5a95c657d1a9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:59 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e8fcd7e7-ba28-431f-9691-5a95c657d1a9 Jul 14 21:29:59 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:59 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e8fcd7e7-ba28-431f-9691-5a95c657d1a9" returned: 0 in 0.250s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-quobyte-e8fcd7e7-ba28-431f-9691-5a95c657d1a9" released by "delete_volume" :: held 0.646s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Created reservations ['20dab417-c9b3-431b-a86b-c6df8c0b79d0', 'f62a371e-4da1-438a-8434-f3d5ee3caccf', '7044cf8d-6139-4e81-a6f3-4ba2161255f7', '97643db5-1938-41a8-aa69-92de0fceaba2'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:59 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:29:59 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:29:59 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.244s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:29:59 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Deleted volume successfully. Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3a6c2b92-c165-4fc6-9b53-b9d0031f84f8 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-e8fcd7e7-ba28-431f-9691-5a95c657d1a9-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "cinder-1aeda307-8f15-45a5-8c87-e99811878b7b-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-1aeda307-8f15-45a5-8c87-e99811878b7b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "cinder-quobyte-1aeda307-8f15-45a5-8c87-e99811878b7b" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-quobyte-1aeda307-8f15-45a5-8c87-e99811878b7b" acquired by "delete_volume" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0834f480-39b1-46e3-ae6b-7f475799b31b]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:29:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1aeda307-8f15-45a5-8c87-e99811878b7b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:29:59 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1aeda307-8f15-45a5-8c87-e99811878b7b Jul 14 21:29:59 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:00 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1aeda307-8f15-45a5-8c87-e99811878b7b" returned: 0 in 0.358s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1aeda307-8f15-45a5-8c87-e99811878b7b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:00 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1aeda307-8f15-45a5-8c87-e99811878b7b Jul 14 21:30:00 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:00 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-1aeda307-8f15-45a5-8c87-e99811878b7b" returned: 0 in 0.238s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-quobyte-1aeda307-8f15-45a5-8c87-e99811878b7b" released by "delete_volume" :: held 0.632s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:00 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Created reservations ['11cd85dc-e4c1-4e1b-81e3-145ae1ea9618', '06812683-0afb-4fdd-a71b-4da4c972727e', '500b96ab-5e4e-40f5-a73b-6aa932b3a5b2', 'f7d3289f-0721-48f5-ab41-1dd54d613090'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:30:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:00 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:30:00 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:00 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.244s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:00 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:30:00 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Deleted volume successfully. Jul 14 21:30:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-461a8a1b-a25d-4d54-b1e7-df857b646295 tempest-CreateVolumesFromSourceVolumeTest-1594155497 None] Lock "cinder-1aeda307-8f15-45a5-8c87-e99811878b7b-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Flow 'volume_create_manager' (2b91c849-1618-4aa7-a4cf-421b0854367c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50448d19-91c7-4767-88e2-849b1abc5c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50448d19-91c7-4767-88e2-849b1abc5c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1317676924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117540a4-ae3d-4849-83bb-64864d3930d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0fae454440404eaa4283a86a4a214a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:03Z,use_quota=True,user_id='cd98257db5bb4c9badce9f5e07ed56b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff48bd41-a8bd-4ee1-8abf-0ae153f4d629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff48bd41-a8bd-4ee1-8abf-0ae153f4d629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4dd1d9-673f-4bdf-861a-1734088e6373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4dd1d9-673f-4bdf-861a-1734088e6373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117540a4-ae3d-4849-83bb-64864d3930d0', 'volume_name': 'volume-117540a4-ae3d-4849-83bb-64864d3930d0', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fb5639-5e79-4453-8165-6d0196602a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fb5639-5e79-4453-8165-6d0196602a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c495d5d4-31ca-4130-b2bd-3fa678d07e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:03 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Volume 117540a4-ae3d-4849-83bb-64864d3930d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117540a4-ae3d-4849-83bb-64864d3930d0', 'volume_size': 1} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1317676924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117540a4-ae3d-4849-83bb-64864d3930d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0fae454440404eaa4283a86a4a214a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:03Z,use_quota=True,user_id='cd98257db5bb4c9badce9f5e07ed56b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Creating volume 117540a4-ae3d-4849-83bb-64864d3930d0 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:30:03 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:03 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 1073741824 Jul 14 21:30:03 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:03 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 1073741824" returned: 0 in 0.405s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:03 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 Jul 14 21:30:03 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:04 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0" returned: 0 in 0.240s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:30:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c495d5d4-31ca-4130-b2bd-3fa678d07e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117540a4-ae3d-4849-83bb-64864d3930d0', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1e5e90-128e-4524-8301-c40ba421a7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:04 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Volume volume-117540a4-ae3d-4849-83bb-64864d3930d0 (117540a4-ae3d-4849-83bb-64864d3930d0): created successfully Jul 14 21:30:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1e5e90-128e-4524-8301-c40ba421a7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Flow 'volume_create_manager' (2b91c849-1618-4aa7-a4cf-421b0854367c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:04 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-b0baeacb-912d-4eba-b0fd-6edad73f4f9a tempest-VolumeDependencyTests-1918946717 None] Created volume successfully. Jul 14 21:30:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] Creating offline snapshot e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 of volume 117540a4-ae3d-4849-83bb-64864d3930d0 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:30:04 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3e4be7-f855-441c-9249-a0bd852b703b]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:04 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 Jul 14 21:30:04 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:04 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0" returned: 0 in 0.345s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:04 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 1G Jul 14 21:30:04 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:05 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 1G" returned: 0 in 0.383s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117540a4-ae3d-4849-83bb-64864d3930d0 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:05 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117540a4-ae3d-4849-83bb-64864d3930d0 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 Jul 14 21:30:05 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:05 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117540a4-ae3d-4849-83bb-64864d3930d0 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349" returned: 0 in 0.290s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:05 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 is being set with open permissions: ugo+rw Jul 14 21:30:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:05 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 Jul 14 21:30:05 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:05 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349" returned: 0 in 0.236s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:05 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.info Jul 14 21:30:05 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:06 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.info" returned: 0 in 0.244s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:06 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.info is being set with open permissions: ugo+rw Jul 14 21:30:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:06 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.info Jul 14 21:30:06 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:06 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.info" returned: 0 in 0.233s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.810s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:06 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-6f67ea89-5726-41b0-81a3-eeee24cfa2b8 tempest-VolumeDependencyTests-1918946717 None] Create snapshot completed successfully Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Flow 'volume_create_manager' (c10aa207-e3d6-4036-9d0f-f1aa0407f943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5563ec67-79f9-4530-b6fc-f171025f4c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5563ec67-79f9-4530-b6fc-f171025f4c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-225750448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7622a2e-4106-451a-9046-bed288cd2cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0fae454440404eaa4283a86a4a214a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e2cd2e21-c76f-4bb7-afa5-b1ea6609a349,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:07Z,use_quota=True,user_id='cd98257db5bb4c9badce9f5e07ed56b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8741ad75-f2e0-4856-896f-d4588153e164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8741ad75-f2e0-4856-896f-d4588153e164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d15b7cbb-bb51-4ca3-b52c-b213474e886a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d15b7cbb-bb51-4ca3-b52c-b213474e886a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd7622a2e-4106-451a-9046-bed288cd2cf9', 'volume_name': 'volume-d7622a2e-4106-451a-9046-bed288cd2cf9', 'volume_size': 1, 'snapshot_id': 'e2cd2e21-c76f-4bb7-afa5-b1ea6609a349'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a4ca9e-4573-4991-986d-930122c453b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a4ca9e-4573-4991-986d-930122c453b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ae6e80-48e5-4276-b0f5-d1219e1d9acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:07 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Volume d7622a2e-4106-451a-9046-bed288cd2cf9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d7622a2e-4106-451a-9046-bed288cd2cf9', 'volume_size': 1, 'snapshot_id': 'e2cd2e21-c76f-4bb7-afa5-b1ea6609a349'} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Acquiring lock "cinder-quobyte-e2cd2e21-c76f-4bb7-afa5-b1ea6609a349-d7622a2e-4106-451a-9046-bed288cd2cf9" by "_create_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-quobyte-e2cd2e21-c76f-4bb7-afa5-b1ea6609a349-d7622a2e-4106-451a-9046-bed288cd2cf9" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Creating volume d7622a2e-4106-451a-9046-bed288cd2cf9 from snapshot e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 {{(pid=88300) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Acquiring lock "cinder-quobyte-d7622a2e-4106-451a-9046-bed288cd2cf9" by "_copy_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-quobyte-d7622a2e-4106-451a-9046-bed288cd2cf9" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] snapshot: e2cd2e21-c76f-4bb7-afa5-b1ea6609a349, volume: d7622a2e-4106-451a-9046-bed288cd2cf9, {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ddb0d0-7674-4c58-93f5-21c2c1d5a102]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:07 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 Jul 14 21:30:07 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:07 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349" returned: 0 in 0.363s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117540a4-ae3d-4849-83bb-64864d3930d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Creating direct copy from snapshot {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[eace26a3-dd0b-4c49-9d24-5356870b0fd2]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:07 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 Jul 14 21:30:07 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:08 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0" returned: 0 in 0.349s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:08 devstack cinder-volume[88300]: DEBUG cinder.utils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Path /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d7622a2e-4106-451a-9046-bed288cd2cf9 not found in is_blk_device check {{(pid=88300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 21:30:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d7622a2e-4106-451a-9046-bed288cd2cf9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:08 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d7622a2e-4106-451a-9046-bed288cd2cf9 Jul 14 21:30:08 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:12 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d7622a2e-4106-451a-9046-bed288cd2cf9" returned: 0 in 3.980s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:12 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[14167780-369c-4d67-a4a1-741b3b19ba1a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:12 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 Jul 14 21:30:12 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:12 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0" returned: 0 in 0.522s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:12 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Image conversion details: src /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0, size 1024.00 MB, duration 3.98 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d7622a2e-4106-451a-9046-bed288cd2cf9 {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:30:12 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Converted 1024.00 MB image at 257.11 MB/s Jul 14 21:30:12 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d7622a2e-4106-451a-9046-bed288cd2cf9 is being set with open permissions: ugo+rw Jul 14 21:30:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d7622a2e-4106-451a-9046-bed288cd2cf9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:12 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d7622a2e-4106-451a-9046-bed288cd2cf9 Jul 14 21:30:12 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:12 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d7622a2e-4106-451a-9046-bed288cd2cf9" returned: 0 in 0.234s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-quobyte-d7622a2e-4106-451a-9046-bed288cd2cf9" released by "_copy_volume_from_snapshot" :: held 5.541s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-quobyte-e2cd2e21-c76f-4bb7-afa5-b1ea6609a349-d7622a2e-4106-451a-9046-bed288cd2cf9" released by "_create_volume_from_snapshot" :: held 5.567s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.580s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ae6e80-48e5-4276-b0f5-d1219e1d9acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7622a2e-4106-451a-9046-bed288cd2cf9', 'volume_size': 1, 'snapshot_id': 'e2cd2e21-c76f-4bb7-afa5-b1ea6609a349'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0756150f-5375-4b22-9d8d-d26a18970ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:12 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Volume volume-d7622a2e-4106-451a-9046-bed288cd2cf9 (d7622a2e-4106-451a-9046-bed288cd2cf9): created successfully Jul 14 21:30:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0756150f-5375-4b22-9d8d-d26a18970ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Flow 'volume_create_manager' (c10aa207-e3d6-4036-9d0f-f1aa0407f943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:12 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-8a384917-c141-4970-897a-e71f707f712c tempest-VolumeDependencyTests-1918946717 None] Created volume successfully. Jul 14 21:30:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] Acquiring lock "cinder-e2cd2e21-c76f-4bb7-afa5-b1ea6609a349-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-e2cd2e21-c76f-4bb7-afa5-b1ea6609a349-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] Acquiring lock "cinder-quobyte-117540a4-ae3d-4849-83bb-64864d3930d0" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-quobyte-117540a4-ae3d-4849-83bb-64864d3930d0" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] Acquiring lock "cinder-quobyte-e2cd2e21-c76f-4bb7-afa5-b1ea6609a349" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-quobyte-e2cd2e21-c76f-4bb7-afa5-b1ea6609a349" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:13 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] Deleting offline snapshot e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 of volume 117540a4-ae3d-4849-83bb-64864d3930d0 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:30:13 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] snapshot_file for this snap is: volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:30:13 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[380b9207-dd9f-468f-a127-90a99c0209b2]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:13 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 Jul 14 21:30:13 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:14 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349" returned: 0 in 0.341s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117540a4-ae3d-4849-83bb-64864d3930d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:30:14 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a843041-c417-454e-aa64-7cf1c8efd76a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:14 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 Jul 14 21:30:14 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:14 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0" returned: 0 in 0.343s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:14 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 Jul 14 21:30:14 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:14 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349" returned: 0 in 0.325s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:14 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349 Jul 14 21:30:14 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:15 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0.e2cd2e21-c76f-4bb7-afa5-b1ea6609a349" returned: 0 in 0.241s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-quobyte-e2cd2e21-c76f-4bb7-afa5-b1ea6609a349" released by "_delete_snapshot" :: held 1.335s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-quobyte-117540a4-ae3d-4849-83bb-64864d3930d0" released by "delete_snapshot" :: held 1.356s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:15 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] Created reservations ['218bf588-9811-42d0-9157-f581f76788c0', '8aca538e-bfd4-42fd-87fe-d798b845487e', '1ac2ea79-6732-43ac-9f93-26fd702320a5', '34cc68b0-bfd2-41a8-ad7d-307c99ca0449'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:30:15 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] Delete snapshot completed successfully. Jul 14 21:30:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5b95e244-6893-43e4-8a4c-b13fc5b97c85 tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-e2cd2e21-c76f-4bb7-afa5-b1ea6609a349-delete_snapshot" released by "delete_snapshot" :: held 1.480s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] Acquiring lock "cinder-117540a4-ae3d-4849-83bb-64864d3930d0-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-117540a4-ae3d-4849-83bb-64864d3930d0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] Acquiring lock "cinder-quobyte-117540a4-ae3d-4849-83bb-64864d3930d0" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-quobyte-117540a4-ae3d-4849-83bb-64864d3930d0" acquired by "delete_volume" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:15 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb35912-516a-4864-b8c3-264389c1637b]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:16 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 Jul 14 21:30:16 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:16 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0" returned: 0 in 0.341s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:16 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0 Jul 14 21:30:16 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:16 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-117540a4-ae3d-4849-83bb-64864d3930d0" returned: 0 in 0.242s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-quobyte-117540a4-ae3d-4849-83bb-64864d3930d0" released by "delete_volume" :: held 0.640s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:16 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] Created reservations ['35ae9d7b-25da-41be-bd90-38f7387c819f', 'c17d8ecc-e7df-4045-9904-4aa79211c24e', 'a34b4e61-e280-455c-9c80-5378e9a31867', '8a3ef2d7-d5c0-4071-938d-e7f7bf58fb91'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:30:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:16 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:30:16 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:16 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.235s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:16 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:30:16 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] Deleted volume successfully. Jul 14 21:30:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-96023d57-7b50-4bb8-9ec9-c85a2bb54654 tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-117540a4-ae3d-4849-83bb-64864d3930d0-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] Acquiring lock "cinder-d7622a2e-4106-451a-9046-bed288cd2cf9-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-d7622a2e-4106-451a-9046-bed288cd2cf9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] Acquiring lock "cinder-quobyte-d7622a2e-4106-451a-9046-bed288cd2cf9" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-quobyte-d7622a2e-4106-451a-9046-bed288cd2cf9" acquired by "delete_volume" :: waited 0.013s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14ad660-2155-4cbc-b23c-39dbc830108a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d7622a2e-4106-451a-9046-bed288cd2cf9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:17 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d7622a2e-4106-451a-9046-bed288cd2cf9 Jul 14 21:30:17 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:17 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d7622a2e-4106-451a-9046-bed288cd2cf9" returned: 0 in 0.343s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d7622a2e-4106-451a-9046-bed288cd2cf9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:17 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d7622a2e-4106-451a-9046-bed288cd2cf9 Jul 14 21:30:17 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:17 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d7622a2e-4106-451a-9046-bed288cd2cf9" returned: 0 in 0.237s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-quobyte-d7622a2e-4106-451a-9046-bed288cd2cf9" released by "delete_volume" :: held 0.618s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=135,cinder:INSERT=46,cinder:UPDATE=176,cinder:DELETE=20 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=128,cinder:INSERT=50,cinder:UPDATE=192,cinder:DELETE=11 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] Created reservations ['50117675-a369-4157-9e7d-b9c028fe8268', '7612c7ec-32d6-4828-b6f1-830bca2024b9', '27dcb42d-ed51-4fca-893d-a86ffd933209', '771e8b03-805a-46ab-9150-a1c879307945'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:17 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:30:17 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:18 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.232s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:18 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:30:18 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] Deleted volume successfully. Jul 14 21:30:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d6747e5c-7998-40d2-b91c-8209348164b3 tempest-VolumeDependencyTests-1918946717 None] Lock "cinder-d7622a2e-4106-451a-9046-bed288cd2cf9-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Flow 'volume_create_manager' (7611d649-61bd-4e2c-a854-0284c005cbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f513bcf9-765a-466f-9ece-7c6e80748b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f513bcf9-765a-466f-9ece-7c6e80748b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2d02a9-c029-4911-aa2f-d332cf8335f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc3fb0cc60240edbb956b0dde4158aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:21Z,use_quota=True,user_id='8cf59fea82b44421b330ee084c6a027a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b2d904-60d0-4c4a-beeb-cf72fe48c865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b2d904-60d0-4c4a-beeb-cf72fe48c865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05733903-1eaf-4347-b5b7-434148fa7d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05733903-1eaf-4347-b5b7-434148fa7d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e2d02a9-c029-4911-aa2f-d332cf8335f4', 'volume_name': 'volume-0e2d02a9-c029-4911-aa2f-d332cf8335f4', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8126f069-3426-4db5-9d9f-1bc967723cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8126f069-3426-4db5-9d9f-1bc967723cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ed3425-e5ae-4b71-9804-6bb74f8645d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:20 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Volume 0e2d02a9-c029-4911-aa2f-d332cf8335f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e2d02a9-c029-4911-aa2f-d332cf8335f4', 'volume_size': 1} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2d02a9-c029-4911-aa2f-d332cf8335f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc3fb0cc60240edbb956b0dde4158aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:21Z,use_quota=True,user_id='8cf59fea82b44421b330ee084c6a027a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Creating volume 0e2d02a9-c029-4911-aa2f-d332cf8335f4 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:30:20 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:30:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0e2d02a9-c029-4911-aa2f-d332cf8335f4 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:20 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0e2d02a9-c029-4911-aa2f-d332cf8335f4 1073741824 Jul 14 21:30:20 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:21 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0e2d02a9-c029-4911-aa2f-d332cf8335f4 1073741824" returned: 0 in 0.391s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0e2d02a9-c029-4911-aa2f-d332cf8335f4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:21 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0e2d02a9-c029-4911-aa2f-d332cf8335f4 Jul 14 21:30:21 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:21 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0e2d02a9-c029-4911-aa2f-d332cf8335f4" returned: 0 in 0.249s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:30:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ed3425-e5ae-4b71-9804-6bb74f8645d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e2d02a9-c029-4911-aa2f-d332cf8335f4', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c1a610-f18d-4c91-855c-949cf37022d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:21 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Volume volume-0e2d02a9-c029-4911-aa2f-d332cf8335f4 (0e2d02a9-c029-4911-aa2f-d332cf8335f4): created successfully Jul 14 21:30:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c1a610-f18d-4c91-855c-949cf37022d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Flow 'volume_create_manager' (7611d649-61bd-4e2c-a854-0284c005cbf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:21 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-1274cc30-8482-4291-b3bb-865b5ae9da2f tempest-CinderUnicodeTest-535782830 None] Created volume successfully. Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Flow 'volume_create_manager' (1f1b5cdc-3199-4cc3-ae00-faa25ec950e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d78fa5fe-88d0-499a-bec9-14bfc286154b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d78fa5fe-88d0-499a-bec9-14bfc286154b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-127040214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d345a53d-c7ae-4c48-99c6-74ca9025b2c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc3fb0cc60240edbb956b0dde4158aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:22Z,use_quota=True,user_id='8cf59fea82b44421b330ee084c6a027a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d08e6de-84b9-4f6a-aed1-e5293ed58ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d08e6de-84b9-4f6a-aed1-e5293ed58ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2365467-1ba0-485a-acb6-5ad135aa4b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2365467-1ba0-485a-acb6-5ad135aa4b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd345a53d-c7ae-4c48-99c6-74ca9025b2c5', 'volume_name': 'volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfb3310-7720-4542-a620-d993c972a5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfb3310-7720-4542-a620-d993c972a5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1372ae2c-f980-405c-92df-c6a319f513b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:22 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Volume d345a53d-c7ae-4c48-99c6-74ca9025b2c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5', 'volume_size': 1} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-127040214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d345a53d-c7ae-4c48-99c6-74ca9025b2c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc3fb0cc60240edbb956b0dde4158aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:22Z,use_quota=True,user_id='8cf59fea82b44421b330ee084c6a027a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Creating volume d345a53d-c7ae-4c48-99c6-74ca9025b2c5 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:30:22 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:22 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5 1073741824 Jul 14 21:30:22 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:22 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5 1073741824" returned: 0 in 0.422s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:22 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5 Jul 14 21:30:22 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:23 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5" returned: 0 in 0.238s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:30:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1372ae2c-f980-405c-92df-c6a319f513b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e19b5f-4651-444f-bb3a-1b7c5ace04fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:23 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Volume volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5 (d345a53d-c7ae-4c48-99c6-74ca9025b2c5): created successfully Jul 14 21:30:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e19b5f-4651-444f-bb3a-1b7c5ace04fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:23 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Flow 'volume_create_manager' (1f1b5cdc-3199-4cc3-ae00-faa25ec950e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:23 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-42262fa3-2bc3-4d44-8e60-117c6f9fd5eb tempest-CinderUnicodeTest-535782830 None] Created volume successfully. Jul 14 21:30:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:23 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] Creating offline snapshot 439a6afc-52ce-4da0-ad0f-647b1c1af7ca of volume d345a53d-c7ae-4c48-99c6-74ca9025b2c5 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:30:23 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6699fb4-e4a1-48aa-8b77-c00886ecfe40]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:23 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5 Jul 14 21:30:23 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:23 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5" returned: 0 in 0.348s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:23 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca 1G Jul 14 21:30:23 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:24 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca 1G" returned: 0 in 0.381s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:24 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca Jul 14 21:30:24 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:24 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca" returned: 0 in 0.285s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:24 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca is being set with open permissions: ugo+rw Jul 14 21:30:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:24 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca Jul 14 21:30:24 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:24 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca" returned: 0 in 0.247s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:24 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.info Jul 14 21:30:24 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:25 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.info" returned: 0 in 0.242s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:25 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.info is being set with open permissions: ugo+rw Jul 14 21:30:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:25 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.info Jul 14 21:30:25 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:25 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.info" returned: 0 in 0.235s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.816s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:25 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-98873d0c-ade4-4370-a5ca-388e9cc17745 tempest-CinderUnicodeTest-535782830 None] Create snapshot completed successfully Jul 14 21:30:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] Acquiring lock "cinder-439a6afc-52ce-4da0-ad0f-647b1c1af7ca-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] Lock "cinder-439a6afc-52ce-4da0-ad0f-647b1c1af7ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] Acquiring lock "cinder-quobyte-d345a53d-c7ae-4c48-99c6-74ca9025b2c5" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] Lock "cinder-quobyte-d345a53d-c7ae-4c48-99c6-74ca9025b2c5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] Acquiring lock "cinder-quobyte-439a6afc-52ce-4da0-ad0f-647b1c1af7ca" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] Lock "cinder-quobyte-439a6afc-52ce-4da0-ad0f-647b1c1af7ca" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] Deleting offline snapshot 439a6afc-52ce-4da0-ad0f-647b1c1af7ca of volume d345a53d-c7ae-4c48-99c6-74ca9025b2c5 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:30:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] snapshot_file for this snap is: volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:30:25 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba953767-d9c3-40fa-b866-f7f39b79b75a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:25 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca Jul 14 21:30:25 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:26 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca" returned: 0 in 0.348s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:26 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:30:26 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3c98bc-b17d-45c1-add4-52975a582d6e]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:26 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5 Jul 14 21:30:26 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:26 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5" returned: 0 in 0.340s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:26 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca Jul 14 21:30:26 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:26 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca" returned: 0 in 0.343s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:26 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca Jul 14 21:30:26 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:27 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5.439a6afc-52ce-4da0-ad0f-647b1c1af7ca" returned: 0 in 0.236s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] Lock "cinder-quobyte-439a6afc-52ce-4da0-ad0f-647b1c1af7ca" released by "_delete_snapshot" :: held 1.356s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] Lock "cinder-quobyte-d345a53d-c7ae-4c48-99c6-74ca9025b2c5" released by "delete_snapshot" :: held 1.377s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:27 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] Created reservations ['4b61fd6a-d8fc-4573-baef-de519fdff614', 'c7f1dba0-260c-49bb-83c8-85a2983ac0c8', '3f6b65b1-6f4d-4350-b9a7-35e58fde200e', 'f030562f-5131-4bc1-9230-138051de0244'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:30:27 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] Delete snapshot completed successfully. Jul 14 21:30:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-43ca2eb2-56d3-47bb-9e06-f4c4ebf58fed tempest-CinderUnicodeTest-535782830 None] Lock "cinder-439a6afc-52ce-4da0-ad0f-647b1c1af7ca-delete_snapshot" released by "delete_snapshot" :: held 1.506s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] Acquiring lock "cinder-d345a53d-c7ae-4c48-99c6-74ca9025b2c5-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] Lock "cinder-d345a53d-c7ae-4c48-99c6-74ca9025b2c5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] Acquiring lock "cinder-quobyte-d345a53d-c7ae-4c48-99c6-74ca9025b2c5" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] Lock "cinder-quobyte-d345a53d-c7ae-4c48-99c6-74ca9025b2c5" acquired by "delete_volume" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:27 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[76be6be7-664c-4cfe-95a3-cfd51ab6d74f]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:28 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5 Jul 14 21:30:28 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:28 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5" returned: 0 in 0.352s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:28 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5 Jul 14 21:30:28 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:28 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-d345a53d-c7ae-4c48-99c6-74ca9025b2c5" returned: 0 in 0.239s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:28 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] Lock "cinder-quobyte-d345a53d-c7ae-4c48-99c6-74ca9025b2c5" released by "delete_volume" :: held 0.648s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:28 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] Created reservations ['ce764567-35b8-40dc-be4c-a5056ed73568', 'd25951ba-816f-44c7-864d-ffa1efef90f4', 'fce781de-9182-4957-8720-710b7a57fb33', '54a1bd8d-0d26-4858-a150-ae4e3cbfa79c'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:30:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:28 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:28 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:28 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:30:28 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:28 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.245s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:28 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:30:28 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] Deleted volume successfully. Jul 14 21:30:28 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-842b127f-4805-4acc-b81a-58ebec988978 tempest-CinderUnicodeTest-535782830 None] Lock "cinder-d345a53d-c7ae-4c48-99c6-74ca9025b2c5-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:28 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] Acquiring lock "cinder-0e2d02a9-c029-4911-aa2f-d332cf8335f4-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:28 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] Lock "cinder-0e2d02a9-c029-4911-aa2f-d332cf8335f4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] Acquiring lock "cinder-quobyte-0e2d02a9-c029-4911-aa2f-d332cf8335f4" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] Lock "cinder-quobyte-0e2d02a9-c029-4911-aa2f-d332cf8335f4" acquired by "delete_volume" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:29 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[db53dc1c-51f9-4444-b469-4d45604618cf]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0e2d02a9-c029-4911-aa2f-d332cf8335f4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:29 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0e2d02a9-c029-4911-aa2f-d332cf8335f4 Jul 14 21:30:29 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:29 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0e2d02a9-c029-4911-aa2f-d332cf8335f4" returned: 0 in 0.354s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0e2d02a9-c029-4911-aa2f-d332cf8335f4 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:29 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0e2d02a9-c029-4911-aa2f-d332cf8335f4 Jul 14 21:30:29 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:29 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0e2d02a9-c029-4911-aa2f-d332cf8335f4" returned: 0 in 0.254s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] Lock "cinder-quobyte-0e2d02a9-c029-4911-aa2f-d332cf8335f4" released by "delete_volume" :: held 0.647s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:29 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] Created reservations ['8091a93c-7857-4561-8661-a0988562a4c4', '5bbad370-3f2b-4c88-97c9-a3a6d6662ab6', 'b2942765-31e0-497d-9dbe-4e3010b509d7', '68b97dd1-2e30-4cf1-9fc1-382a42a9d096'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:30:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:29 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:30:29 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:30 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.234s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:30 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:30:30 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] Deleted volume successfully. Jul 14 21:30:30 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3df8a77a-18a1-4294-87ee-598c70bfd91f tempest-CinderUnicodeTest-535782830 None] Lock "cinder-0e2d02a9-c029-4911-aa2f-d332cf8335f4-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Flow 'volume_create_manager' (ca04bfa6-8e17-4ec4-93f3-821ac5edae32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5c4a55-45a2-4026-b9b0-073e81a149d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5c4a55-45a2-4026-b9b0-073e81a149d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2031405445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d77eb57-722c-4a44-9673-f5059124fa25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55b04319be64accaff625b8d0a39d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:33Z,use_quota=True,user_id='62c60f6910c6417a8e15371dae48f57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39c9ac7-1aa5-4820-bf7d-8d6883b9ae6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39c9ac7-1aa5-4820-bf7d-8d6883b9ae6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287fc2da-c69e-4a50-843e-b2a9b5200d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287fc2da-c69e-4a50-843e-b2a9b5200d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d77eb57-722c-4a44-9673-f5059124fa25', 'volume_name': 'volume-3d77eb57-722c-4a44-9673-f5059124fa25', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252397bd-da99-4f38-aed7-b3f9ef09faeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252397bd-da99-4f38-aed7-b3f9ef09faeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb77f27b-8455-4520-a9e1-6a4b114d18e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:33 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Volume 3d77eb57-722c-4a44-9673-f5059124fa25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d77eb57-722c-4a44-9673-f5059124fa25', 'volume_size': 1} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2031405445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d77eb57-722c-4a44-9673-f5059124fa25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55b04319be64accaff625b8d0a39d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:33Z,use_quota=True,user_id='62c60f6910c6417a8e15371dae48f57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Creating volume 3d77eb57-722c-4a44-9673-f5059124fa25 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:30:33 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3d77eb57-722c-4a44-9673-f5059124fa25 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:33 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3d77eb57-722c-4a44-9673-f5059124fa25 1073741824 Jul 14 21:30:33 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:33 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3d77eb57-722c-4a44-9673-f5059124fa25 1073741824" returned: 0 in 0.404s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3d77eb57-722c-4a44-9673-f5059124fa25 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:33 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3d77eb57-722c-4a44-9673-f5059124fa25 Jul 14 21:30:33 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:34 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3d77eb57-722c-4a44-9673-f5059124fa25" returned: 0 in 0.238s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:34 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:30:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb77f27b-8455-4520-a9e1-6a4b114d18e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d77eb57-722c-4a44-9673-f5059124fa25', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a573b3-4fda-4177-bda0-1c37b78285d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:34 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Volume volume-3d77eb57-722c-4a44-9673-f5059124fa25 (3d77eb57-722c-4a44-9673-f5059124fa25): created successfully Jul 14 21:30:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a573b3-4fda-4177-bda0-1c37b78285d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:34 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Flow 'volume_create_manager' (ca04bfa6-8e17-4ec4-93f3-821ac5edae32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:34 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-c0bf51f7-406f-4084-82c0-157417179fb0 tempest-ProjectReaderTests-1531755459 None] Created volume successfully. Jul 14 21:30:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] Acquiring lock "cinder-3d77eb57-722c-4a44-9673-f5059124fa25-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] Lock "cinder-3d77eb57-722c-4a44-9673-f5059124fa25-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] Acquiring lock "cinder-quobyte-3d77eb57-722c-4a44-9673-f5059124fa25" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] Lock "cinder-quobyte-3d77eb57-722c-4a44-9673-f5059124fa25" acquired by "delete_volume" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:34 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ff386c-171b-4339-a387-838ec7a59112]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3d77eb57-722c-4a44-9673-f5059124fa25 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:34 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3d77eb57-722c-4a44-9673-f5059124fa25 Jul 14 21:30:34 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:34 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3d77eb57-722c-4a44-9673-f5059124fa25" returned: 0 in 0.361s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3d77eb57-722c-4a44-9673-f5059124fa25 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:34 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3d77eb57-722c-4a44-9673-f5059124fa25 Jul 14 21:30:34 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:35 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3d77eb57-722c-4a44-9673-f5059124fa25" returned: 0 in 0.236s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] Lock "cinder-quobyte-3d77eb57-722c-4a44-9673-f5059124fa25" released by "delete_volume" :: held 0.636s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:35 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] Created reservations ['78f05510-79c6-4092-9d15-e2f5714f1b8b', 'be41647c-22f7-4c44-8d33-b4498560d141', 'b34d1b0f-1e37-482d-bc33-edcc70e245f6', '6e1f0473-2944-4091-bf59-a2f58b5477ff'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:30:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:35 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:30:35 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:35 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.259s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:35 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:30:35 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] Deleted volume successfully. Jul 14 21:30:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5a85d9f9-5d80-4344-b56d-a7b74104214a tempest-ProjectReaderTests-1531755459 None] Lock "cinder-3d77eb57-722c-4a44-9673-f5059124fa25-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Flow 'volume_create_manager' (dd954e02-3963-4b48-a208-f942a850dc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fe369a-f6b8-4e1b-85cf-98edd38af7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fe369a-f6b8-4e1b-85cf-98edd38af7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1769184976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6781b05e-7d8a-4075-aeb7-86a432012dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55b04319be64accaff625b8d0a39d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:36Z,use_quota=True,user_id='62c60f6910c6417a8e15371dae48f57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84db0d47-fe33-4c80-9ff6-bf9ad6d211ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84db0d47-fe33-4c80-9ff6-bf9ad6d211ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5d7de8-fe60-4140-a845-66fb38c69115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5d7de8-fe60-4140-a845-66fb38c69115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6781b05e-7d8a-4075-aeb7-86a432012dfe', 'volume_name': 'volume-6781b05e-7d8a-4075-aeb7-86a432012dfe', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b694f170-2892-41b1-82c4-65061e35eafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b694f170-2892-41b1-82c4-65061e35eafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee24943-b4d7-4914-a92b-8b10abc1a60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:36 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Volume 6781b05e-7d8a-4075-aeb7-86a432012dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6781b05e-7d8a-4075-aeb7-86a432012dfe', 'volume_size': 1} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1769184976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6781b05e-7d8a-4075-aeb7-86a432012dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55b04319be64accaff625b8d0a39d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:36Z,use_quota=True,user_id='62c60f6910c6417a8e15371dae48f57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Creating volume 6781b05e-7d8a-4075-aeb7-86a432012dfe {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:30:36 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6781b05e-7d8a-4075-aeb7-86a432012dfe 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:36 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6781b05e-7d8a-4075-aeb7-86a432012dfe 1073741824 Jul 14 21:30:36 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:36 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6781b05e-7d8a-4075-aeb7-86a432012dfe 1073741824" returned: 0 in 0.392s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6781b05e-7d8a-4075-aeb7-86a432012dfe {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:36 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6781b05e-7d8a-4075-aeb7-86a432012dfe Jul 14 21:30:36 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:36 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:30:36 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:36 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6781b05e-7d8a-4075-aeb7-86a432012dfe" returned: 0 in 0.245s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee24943-b4d7-4914-a92b-8b10abc1a60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6781b05e-7d8a-4075-aeb7-86a432012dfe', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948aac43-e97b-4cad-ae86-eae908e8390c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:36 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Volume volume-6781b05e-7d8a-4075-aeb7-86a432012dfe (6781b05e-7d8a-4075-aeb7-86a432012dfe): created successfully Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948aac43-e97b-4cad-ae86-eae908e8390c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Flow 'volume_create_manager' (dd954e02-3963-4b48-a208-f942a850dc27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:36 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-5fe89051-e047-444d-871e-a0877ac72138 tempest-ProjectReaderTests-1531755459 None] Created volume successfully. Jul 14 21:30:36 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.268s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 28 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:30:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:30:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] Acquiring lock "cinder-6781b05e-7d8a-4075-aeb7-86a432012dfe-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] Lock "cinder-6781b05e-7d8a-4075-aeb7-86a432012dfe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] Acquiring lock "cinder-quobyte-6781b05e-7d8a-4075-aeb7-86a432012dfe" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] Lock "cinder-quobyte-6781b05e-7d8a-4075-aeb7-86a432012dfe" acquired by "delete_volume" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:37 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ec90aa-791a-4090-bfde-3045d2a734e7]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6781b05e-7d8a-4075-aeb7-86a432012dfe {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:37 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6781b05e-7d8a-4075-aeb7-86a432012dfe Jul 14 21:30:37 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:37 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6781b05e-7d8a-4075-aeb7-86a432012dfe" returned: 0 in 0.342s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6781b05e-7d8a-4075-aeb7-86a432012dfe {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:37 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6781b05e-7d8a-4075-aeb7-86a432012dfe Jul 14 21:30:37 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:37 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6781b05e-7d8a-4075-aeb7-86a432012dfe" returned: 0 in 0.235s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] Lock "cinder-quobyte-6781b05e-7d8a-4075-aeb7-86a432012dfe" released by "delete_volume" :: held 0.614s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:37 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] Created reservations ['2a99ed3a-364c-4fef-a19a-251c70235d9d', '9475a972-cef4-40de-91a3-cbf54e3a143d', 'fd80b9d2-b032-4593-967c-f6b4d0c51482', 'b472f851-caf1-47af-b102-d9e7dc736569'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:30:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:37 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:30:37 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:38 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.241s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:38 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:30:38 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] Deleted volume successfully. Jul 14 21:30:38 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9138625f-6ec4-4d59-b840-f1b483cacd23 tempest-ProjectReaderTests-1531755459 None] Lock "cinder-6781b05e-7d8a-4075-aeb7-86a432012dfe-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:47 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:UPDATE=65,cinder:SELECT=45,cinder:INSERT=12,cinder:DELETE=2 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:30:48 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=35,cinder:INSERT=17,cinder:UPDATE=52,cinder:DELETE=8 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Flow 'volume_create_manager' (47898f96-8e76-4b65-9a91-93ab374767d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8756e38-7282-4df2-ba4c-bbf1c97c0633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8756e38-7282-4df2-ba4c-bbf1c97c0633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1127972399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cba5656-22a2-4125-a9ce-64755fe3ec33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8f3cf4ddbe4466d96cc1403d19ecd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:49Z,use_quota=True,user_id='57796d5b53864601bfe6c2ea3c8342f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6020b39f-4e81-47fe-ba28-ad9e91bd2e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6020b39f-4e81-47fe-ba28-ad9e91bd2e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7308f879-d74a-4ec0-b863-1220a3bb9e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7308f879-d74a-4ec0-b863-1220a3bb9e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cba5656-22a2-4125-a9ce-64755fe3ec33', 'volume_name': 'volume-9cba5656-22a2-4125-a9ce-64755fe3ec33', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a1e971-3f92-4788-b6c3-1ea6938102f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a1e971-3f92-4788-b6c3-1ea6938102f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7058776b-f7a9-454e-acc6-6fd0985fc3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:49 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Volume 9cba5656-22a2-4125-a9ce-64755fe3ec33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cba5656-22a2-4125-a9ce-64755fe3ec33', 'volume_size': 1} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1127972399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cba5656-22a2-4125-a9ce-64755fe3ec33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8f3cf4ddbe4466d96cc1403d19ecd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:49Z,use_quota=True,user_id='57796d5b53864601bfe6c2ea3c8342f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Creating volume 9cba5656-22a2-4125-a9ce-64755fe3ec33 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:30:49 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9cba5656-22a2-4125-a9ce-64755fe3ec33 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:49 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9cba5656-22a2-4125-a9ce-64755fe3ec33 1073741824 Jul 14 21:30:49 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Flow 'volume_create_manager' (10e7dfe2-af79-496e-aceb-975fc2f0566e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58562833-de22-4ec4-8d5b-4f6d83cb2631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58562833-de22-4ec4-8d5b-4f6d83cb2631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1444292422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623ec221-4eb9-4338-820f-f92fd9c93a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae91db5c4f3f4fea8b6be26a3da876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:50Z,use_quota=True,user_id='b54111a40b8c4ec8a021b3d859653cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a121d31-9579-4717-adfd-176cfcb69dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a121d31-9579-4717-adfd-176cfcb69dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d5a383-3116-45af-8a44-62fbdb3d91d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d5a383-3116-45af-8a44-62fbdb3d91d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '623ec221-4eb9-4338-820f-f92fd9c93a1c', 'volume_name': 'volume-623ec221-4eb9-4338-820f-f92fd9c93a1c', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd67fe90-4428-479f-91a1-99155a9b28e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd67fe90-4428-479f-91a1-99155a9b28e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611cb89c-2599-45bb-94a0-72bdb7d8bf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:49 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume 623ec221-4eb9-4338-820f-f92fd9c93a1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-623ec221-4eb9-4338-820f-f92fd9c93a1c', 'volume_size': 1} Jul 14 21:30:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:50 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9cba5656-22a2-4125-a9ce-64755fe3ec33 1073741824" returned: 0 in 0.585s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9cba5656-22a2-4125-a9ce-64755fe3ec33 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:30:50 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9cba5656-22a2-4125-a9ce-64755fe3ec33 Jul 14 21:30:50 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Flow 'volume_create_manager' (5349fd33-41fc-430f-9a8c-f216c2a4e2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fcdf3f3-323d-449e-bb0e-2043a37f744c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fcdf3f3-323d-449e-bb0e-2043a37f744c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1372569367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a830787-663f-4884-bb29-fda1d894e000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32236c4cc31040bea0651b6e27dfde8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:50Z,use_quota=True,user_id='6ec048c5c5af4cfea1bc1342c78afa19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7c8917-2bdd-4b41-92b5-a52f5fad5553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7c8917-2bdd-4b41-92b5-a52f5fad5553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba455648-4d3b-4340-a7bb-f19ea2ed5631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba455648-4d3b-4340-a7bb-f19ea2ed5631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a830787-663f-4884-bb29-fda1d894e000', 'volume_name': 'volume-6a830787-663f-4884-bb29-fda1d894e000', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414cc9ad-f6b0-4f7f-ad2b-9f99ff6f0dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414cc9ad-f6b0-4f7f-ad2b-9f99ff6f0dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cc3fed-193a-465f-baf6-af069093cc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:50 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Volume 6a830787-663f-4884-bb29-fda1d894e000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a830787-663f-4884-bb29-fda1d894e000', 'volume_size': 1} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Flow 'volume_create_manager' (3930e279-dc5c-4168-acca-db30793e8153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86316a3d-6c0b-48b5-a48a-cc6cd6382bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86316a3d-6c0b-48b5-a48a-cc6cd6382bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1918055295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7a13a1-4c3a-4981-afc1-2c1c123295af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8f3cf4ddbe4466d96cc1403d19ecd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:50Z,use_quota=True,user_id='57796d5b53864601bfe6c2ea3c8342f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a3f2fe-7312-4c60-aee3-763aed61485c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a3f2fe-7312-4c60-aee3-763aed61485c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a568b4c-16dd-4de2-b756-0225e1400cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a568b4c-16dd-4de2-b756-0225e1400cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e7a13a1-4c3a-4981-afc1-2c1c123295af', 'volume_name': 'volume-7e7a13a1-4c3a-4981-afc1-2c1c123295af', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da64f157-22a4-413b-8b2b-fda8847aee38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da64f157-22a4-413b-8b2b-fda8847aee38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a2e6d4-ec43-4c16-bff9-e7cf39fa1441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:50 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Volume 7e7a13a1-4c3a-4981-afc1-2c1c123295af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e7a13a1-4c3a-4981-afc1-2c1c123295af', 'volume_size': 1} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:50 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9cba5656-22a2-4125-a9ce-64755fe3ec33" returned: 0 in 0.365s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.806s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1444292422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623ec221-4eb9-4338-820f-f92fd9c93a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae91db5c4f3f4fea8b6be26a3da876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:50Z,use_quota=True,user_id='b54111a40b8c4ec8a021b3d859653cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Creating volume 623ec221-4eb9-4338-820f-f92fd9c93a1c {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:30:50 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7058776b-f7a9-454e-acc6-6fd0985fc3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cba5656-22a2-4125-a9ce-64755fe3ec33', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:50 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c 1073741824 Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49041708-afd3-40e8-b05e-dc5a7b601852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:50 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Flow 'volume_create_manager' (b7cd4013-acd9-4f93-a021-d52332060d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fae6c10-b61c-4244-bf71-d28a72b86040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:50 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Volume volume-9cba5656-22a2-4125-a9ce-64755fe3ec33 (9cba5656-22a2-4125-a9ce-64755fe3ec33): created successfully Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49041708-afd3-40e8-b05e-dc5a7b601852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Flow 'volume_create_manager' (47898f96-8e76-4b65-9a91-93ab374767d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fae6c10-b61c-4244-bf71-d28a72b86040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1509458535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8d7bda-45af-4321-bb81-3f5785d29c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8f3cf4ddbe4466d96cc1403d19ecd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:51Z,use_quota=True,user_id='57796d5b53864601bfe6c2ea3c8342f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f216eb0f-10f9-41f2-bcc3-a7b3ad771107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f216eb0f-10f9-41f2-bcc3-a7b3ad771107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52e6b0c7-e46c-4c8c-988d-3c4765e6b008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52e6b0c7-e46c-4c8c-988d-3c4765e6b008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d8d7bda-45af-4321-bb81-3f5785d29c87', 'volume_name': 'volume-2d8d7bda-45af-4321-bb81-3f5785d29c87', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf33e0a8-1322-47d2-b082-2d71d60c0ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf33e0a8-1322-47d2-b082-2d71d60c0ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c5c4d6-48e6-4909-bc39-a9f0780b0b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:50 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Volume 2d8d7bda-45af-4321-bb81-3f5785d29c87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d8d7bda-45af-4321-bb81-3f5785d29c87', 'volume_size': 1} Jul 14 21:30:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:50 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a30a7980-96b8-40f1-b6ae-5f4029fe902f tempest-CreateVolumesFromImageTest-550161816 None] Created volume successfully. Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Flow 'volume_create_manager' (49ac04e7-1006-447c-b1e1-f4433d41bd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67feb84-970d-4149-b7d8-2653e4c64a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67feb84-970d-4149-b7d8-2653e4c64a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-685245757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089e8a04-b072-4060-a0dc-563afcbf27bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8f3cf4ddbe4466d96cc1403d19ecd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:51Z,use_quota=True,user_id='57796d5b53864601bfe6c2ea3c8342f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e767a6c-9094-49e2-be4b-ee2a0fd60515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e767a6c-9094-49e2-be4b-ee2a0fd60515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92bdb6bc-7abf-404b-870a-e66b1403a76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92bdb6bc-7abf-404b-870a-e66b1403a76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '089e8a04-b072-4060-a0dc-563afcbf27bf', 'volume_name': 'volume-089e8a04-b072-4060-a0dc-563afcbf27bf', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd75a945-d1df-4799-abb3-a1cce5d8b2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd75a945-d1df-4799-abb3-a1cce5d8b2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c2dc1a-1735-4fa2-bac0-53de872a0e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:51 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Volume 089e8a04-b072-4060-a0dc-563afcbf27bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-089e8a04-b072-4060-a0dc-563afcbf27bf', 'volume_size': 1} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:51 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c 1073741824" returned: 0 in 0.643s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:51 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c Jul 14 21:30:51 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Flow 'volume_create_manager' (1a0f35db-ea88-462b-b0ad-df750a64fc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51955cab-67ff-43c9-925c-1b9dbd1fbb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51955cab-67ff-43c9-925c-1b9dbd1fbb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1967695556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbf5493-260d-439a-a305-964c78d34e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8f3cf4ddbe4466d96cc1403d19ecd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:52Z,use_quota=True,user_id='57796d5b53864601bfe6c2ea3c8342f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc2af16-b3a2-454c-9bea-f3dc8d8ea998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc2af16-b3a2-454c-9bea-f3dc8d8ea998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ed7044-bfd7-4aff-bab6-6a0e048f5a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ed7044-bfd7-4aff-bab6-6a0e048f5a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dbf5493-260d-439a-a305-964c78d34e35', 'volume_name': 'volume-2dbf5493-260d-439a-a305-964c78d34e35', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:51 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52abfbb7-db9d-48a3-9948-54c9ce0c52e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52abfbb7-db9d-48a3-9948-54c9ce0c52e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f414569a-8e95-484b-9418-0b9b8e8ce2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:51 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Volume 2dbf5493-260d-439a-a305-964c78d34e35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dbf5493-260d-439a-a305-964c78d34e35', 'volume_size': 1} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c" returned: 0 in 0.312s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.206s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1372569367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a830787-663f-4884-bb29-fda1d894e000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32236c4cc31040bea0651b6e27dfde8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:50Z,use_quota=True,user_id='6ec048c5c5af4cfea1bc1342c78afa19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Creating volume 6a830787-663f-4884-bb29-fda1d894e000 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:30:51 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:51 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 1073741824 Jul 14 21:30:51 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611cb89c-2599-45bb-94a0-72bdb7d8bf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-623ec221-4eb9-4338-820f-f92fd9c93a1c', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c12bc46-00f4-459f-9c86-6f17ab037892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:51 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume volume-623ec221-4eb9-4338-820f-f92fd9c93a1c (623ec221-4eb9-4338-820f-f92fd9c93a1c): created successfully Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c12bc46-00f4-459f-9c86-6f17ab037892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Flow 'volume_create_manager' (10e7dfe2-af79-496e-aceb-975fc2f0566e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:51 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-5894afa3-ff6f-44ad-be7a-a283e99fd267 tempest-CreateVolumesFromSnapshotTest-44635382 None] Created volume successfully. Jul 14 21:30:52 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 1073741824" returned: 0 in 0.518s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:52 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 Jul 14 21:30:52 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:52 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000" returned: 0 in 0.264s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.934s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1918055295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7a13a1-4c3a-4981-afc1-2c1c123295af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8f3cf4ddbe4466d96cc1403d19ecd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:50Z,use_quota=True,user_id='57796d5b53864601bfe6c2ea3c8342f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Creating volume 7e7a13a1-4c3a-4981-afc1-2c1c123295af {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:30:52 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7e7a13a1-4c3a-4981-afc1-2c1c123295af 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:52 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7e7a13a1-4c3a-4981-afc1-2c1c123295af 1073741824 Jul 14 21:30:52 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cc3fed-193a-465f-baf6-af069093cc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a830787-663f-4884-bb29-fda1d894e000', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a16f42-8cef-41fb-9944-d1d32c262c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:52 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Volume volume-6a830787-663f-4884-bb29-fda1d894e000 (6a830787-663f-4884-bb29-fda1d894e000): created successfully Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a16f42-8cef-41fb-9944-d1d32c262c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Flow 'volume_create_manager' (5349fd33-41fc-430f-9a8c-f216c2a4e2bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:52 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e1b638d0-b253-4dc1-b728-639553bf20f7 tempest-VolumeDependencyTests-446874483 None] Created volume successfully. Jul 14 21:30:53 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7e7a13a1-4c3a-4981-afc1-2c1c123295af 1073741824" returned: 0 in 0.451s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7e7a13a1-4c3a-4981-afc1-2c1c123295af {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:53 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7e7a13a1-4c3a-4981-afc1-2c1c123295af Jul 14 21:30:53 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:53 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7e7a13a1-4c3a-4981-afc1-2c1c123295af" returned: 0 in 0.266s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.456s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1509458535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8d7bda-45af-4321-bb81-3f5785d29c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8f3cf4ddbe4466d96cc1403d19ecd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:51Z,use_quota=True,user_id='57796d5b53864601bfe6c2ea3c8342f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Creating volume 2d8d7bda-45af-4321-bb81-3f5785d29c87 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:30:53 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2d8d7bda-45af-4321-bb81-3f5785d29c87 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:53 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2d8d7bda-45af-4321-bb81-3f5785d29c87 1073741824 Jul 14 21:30:53 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a2e6d4-ec43-4c16-bff9-e7cf39fa1441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e7a13a1-4c3a-4981-afc1-2c1c123295af', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f53fdec-8047-4fec-9ffa-7ed0f04e80fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:53 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Volume volume-7e7a13a1-4c3a-4981-afc1-2c1c123295af (7e7a13a1-4c3a-4981-afc1-2c1c123295af): created successfully Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f53fdec-8047-4fec-9ffa-7ed0f04e80fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Flow 'volume_create_manager' (3930e279-dc5c-4168-acca-db30793e8153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:53 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f4c64045-a126-4b83-93be-5acdbc7fcec9 tempest-CreateVolumesFromImageTest-550161816 None] Created volume successfully. Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Flow 'volume_create_manager' (b6553650-01d6-48a4-8377-dcfa586ad744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aeef0be-97aa-4ec2-bf7c-989525b2859d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aeef0be-97aa-4ec2-bf7c-989525b2859d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c3813a-4286-46f9-a39c-586320942ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edef42103ad24b8699c4e972cce55ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:54Z,use_quota=True,user_id='d8f4a6cef42146c0bb3a30007465ebef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9e58785-142c-4494-b554-30fb03c179e8),volume_type_id=c9e58785-142c-4494-b554-30fb03c179e8)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c58d143-9c79-451d-80f0-c9a8b6d5e433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:53 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c58d143-9c79-451d-80f0-c9a8b6d5e433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2157b4-b024-4c34-aa0f-42fb0a6009d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG cinder.image.glance [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Creating Keystone auth plugin from conf {{(pid=88300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2d8d7bda-45af-4321-bb81-3f5785d29c87 1073741824" returned: 0 in 0.541s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2d8d7bda-45af-4321-bb81-3f5785d29c87 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:54 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2d8d7bda-45af-4321-bb81-3f5785d29c87 Jul 14 21:30:54 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2157b4-b024-4c34-aa0f-42fb0a6009d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '15c3813a-4286-46f9-a39c-586320942ed5', 'volume_name': 'volume-15c3813a-4286-46f9-a39c-586320942ed5', 'volume_size': 1, 'image_id': '1980be45-f4e9-4f90-858e-5df577a0fa48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1980be45-f4e9-4f90-858e-5df577a0fa48', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f8b2d22481686a290110aa63a2dcecba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'edef42103ad24b8699c4e972cce55ee7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '415a9c63f55466f5c09e5047e1ecdd38ba34bac0b4065d2bad171596e9552b2cd95438c7cd53b4182cd950a9a42b63c9c8bbb7cc8dd3aa5dc7c5dcacc236391b', 'id': '1980be45-f4e9-4f90-858e-5df577a0fa48', 'created_at': datetime.datetime(2026, 7, 14, 19, 30, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 30, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1980be45-f4e9-4f90-858e-5df577a0fa48/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68905052-40c5-4c10-9fad-939d75b85fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68905052-40c5-4c10-9fad-939d75b85fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d54851-913f-498e-adb7-97a2599a3495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:54 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Volume 15c3813a-4286-46f9-a39c-586320942ed5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-15c3813a-4286-46f9-a39c-586320942ed5', 'volume_size': 1, 'image_id': '1980be45-f4e9-4f90-858e-5df577a0fa48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1980be45-f4e9-4f90-858e-5df577a0fa48', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f8b2d22481686a290110aa63a2dcecba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'edef42103ad24b8699c4e972cce55ee7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '415a9c63f55466f5c09e5047e1ecdd38ba34bac0b4065d2bad171596e9552b2cd95438c7cd53b4182cd950a9a42b63c9c8bbb7cc8dd3aa5dc7c5dcacc236391b', 'id': '1980be45-f4e9-4f90-858e-5df577a0fa48', 'created_at': datetime.datetime(2026, 7, 14, 19, 30, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 30, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1980be45-f4e9-4f90-858e-5df577a0fa48/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Trying to clone 15c3813a-4286-46f9-a39c-586320942ed5 from image 1980be45-f4e9-4f90-858e-5df577a0fa48 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1980be45-f4e9-4f90-858e-5df577a0fa48', 'metadata': {}}]). {{(pid=88300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 21:30:54 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2d8d7bda-45af-4321-bb81-3f5785d29c87" returned: 0 in 0.250s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.932s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-685245757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089e8a04-b072-4060-a0dc-563afcbf27bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8f3cf4ddbe4466d96cc1403d19ecd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:51Z,use_quota=True,user_id='57796d5b53864601bfe6c2ea3c8342f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Creating volume 089e8a04-b072-4060-a0dc-563afcbf27bf {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:30:54 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-089e8a04-b072-4060-a0dc-563afcbf27bf 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c5c4d6-48e6-4909-bc39-a9f0780b0b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d8d7bda-45af-4321-bb81-3f5785d29c87', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:54 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-089e8a04-b072-4060-a0dc-563afcbf27bf 1073741824 Jul 14 21:30:54 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bb3c1c-6edf-49c8-ae76-a0234380608c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:54 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Volume volume-2d8d7bda-45af-4321-bb81-3f5785d29c87 (2d8d7bda-45af-4321-bb81-3f5785d29c87): created successfully Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bb3c1c-6edf-49c8-ae76-a0234380608c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Flow 'volume_create_manager' (b7cd4013-acd9-4f93-a021-d52332060d00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:54 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a690d383-e0a2-4d4e-a8aa-44cd5858118b tempest-CreateVolumesFromImageTest-550161816 None] Created volume successfully. Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 21:30:54 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Image download 0.00 MB at 0.00 MB/s Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d643e2ff-9aeb-4df4-b03b-8f2a07ce66ee]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:54 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD Jul 14 21:30:54 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:54 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD" returned: 0 in 0.350s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:54 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-089e8a04-b072-4060-a0dc-563afcbf27bf 1073741824" returned: 0 in 0.491s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-089e8a04-b072-4060-a0dc-563afcbf27bf {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:54 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-089e8a04-b072-4060-a0dc-563afcbf27bf Jul 14 21:30:54 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:54 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD Jul 14 21:30:54 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:55 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-089e8a04-b072-4060-a0dc-563afcbf27bf" returned: 0 in 0.243s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.227s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1967695556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbf5493-260d-439a-a305-964c78d34e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8f3cf4ddbe4466d96cc1403d19ecd82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:52Z,use_quota=True,user_id='57796d5b53864601bfe6c2ea3c8342f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Creating volume 2dbf5493-260d-439a-a305-964c78d34e35 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:30:55 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2dbf5493-260d-439a-a305-964c78d34e35 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c2dc1a-1735-4fa2-bac0-53de872a0e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-089e8a04-b072-4060-a0dc-563afcbf27bf', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:55 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2dbf5493-260d-439a-a305-964c78d34e35 1073741824 Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9906290-8ea4-4399-9339-869a57e271da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:55 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:55 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD" returned: 1 in 0.333s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Temporary image 1980be45-f4e9-4f90-858e-5df577a0fa48 is fetched for user d8f4a6cef42146c0bb3a30007465ebef. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 21:30:55 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Volume volume-089e8a04-b072-4060-a0dc-563afcbf27bf (089e8a04-b072-4060-a0dc-563afcbf27bf): created successfully Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9906290-8ea4-4399-9339-869a57e271da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Flow 'volume_create_manager' (49ac04e7-1006-447c-b1e1-f4433d41bd9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:55 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-152f2f65-de76-4c86-aeae-a5b930cedcef tempest-CreateVolumesFromImageTest-550161816 None] Created volume successfully. Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ef1c48-f956-4259-8981-2668972e3190]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:55 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD Jul 14 21:30:55 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:55 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2dbf5493-260d-439a-a305-964c78d34e35 1073741824" returned: 0 in 0.412s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2dbf5493-260d-439a-a305-964c78d34e35 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:55 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:55 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2dbf5493-260d-439a-a305-964c78d34e35 Jul 14 21:30:55 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:55 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD Jul 14 21:30:55 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:55 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2dbf5493-260d-439a-a305-964c78d34e35" returned: 0 in 0.258s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.288s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f414569a-8e95-484b-9418-0b9b8e8ce2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dbf5493-260d-439a-a305-964c78d34e35', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8ef994-aec5-4a8f-b0c5-001f9d6b93af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] Creating offline snapshot f92ed097-11d1-4556-aa6d-9539c6403fc7 of volume 623ec221-4eb9-4338-820f-f92fd9c93a1c {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:30:55 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Volume volume-2dbf5493-260d-439a-a305-964c78d34e35 (2dbf5493-260d-439a-a305-964c78d34e35): created successfully Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8ef994-aec5-4a8f-b0c5-001f9d6b93af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Flow 'volume_create_manager' (1a0f35db-ea88-462b-b0ad-df750a64fc5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d919f022-8207-4d04-8fc5-95f7bdacb5ef]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:55 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-b407e96a-d26f-4da1-8268-a8b938e1b591 tempest-CreateVolumesFromImageTest-550161816 None] Created volume successfully. Jul 14 21:30:55 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD" returned: 1 in 0.351s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:30:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:55 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c Jul 14 21:30:55 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "cinder-2dbf5493-260d-439a-a305-964c78d34e35-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-2dbf5493-260d-439a-a305-964c78d34e35-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:56 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c" returned: 0 in 0.369s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:56 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7 1G Jul 14 21:30:56 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "cinder-quobyte-2dbf5493-260d-439a-a305-964c78d34e35" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-quobyte-2dbf5493-260d-439a-a305-964c78d34e35" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:56 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63e1144-5cf5-425e-9432-5524b6d60e96]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2dbf5493-260d-439a-a305-964c78d34e35 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:56 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2dbf5493-260d-439a-a305-964c78d34e35 Jul 14 21:30:56 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:56 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7 1G" returned: 0 in 0.413s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623ec221-4eb9-4338-820f-f92fd9c93a1c -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:56 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623ec221-4eb9-4338-820f-f92fd9c93a1c -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7 Jul 14 21:30:56 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:56 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2dbf5493-260d-439a-a305-964c78d34e35" returned: 0 in 0.371s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2dbf5493-260d-439a-a305-964c78d34e35 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:56 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2dbf5493-260d-439a-a305-964c78d34e35 Jul 14 21:30:56 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:56 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623ec221-4eb9-4338-820f-f92fd9c93a1c -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7" returned: 0 in 0.304s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:56 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7 is being set with open permissions: ugo+rw Jul 14 21:30:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:56 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2dbf5493-260d-439a-a305-964c78d34e35" returned: 0 in 0.256s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-quobyte-2dbf5493-260d-439a-a305-964c78d34e35" released by "delete_volume" :: held 0.673s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:56 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7 Jul 14 21:30:56 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:56 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] Created reservations ['f3de103d-006e-4050-8479-fcdee7be3679', '2cbe4584-e65e-42c3-a249-0148d3322f30', '5abbac0d-dd20-472f-a11d-bfed14ccebe4', '790541e9-dd90-4535-b9ec-758097900e0c'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:57 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:30:57 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:57 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7" returned: 0 in 0.261s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:57 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.info Jul 14 21:30:57 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:57 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.250s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:30:57 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] Deleted volume successfully. Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c91b92ab-407a-4794-a985-a49ef55c76dc tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-2dbf5493-260d-439a-a305-964c78d34e35-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "cinder-089e8a04-b072-4060-a0dc-563afcbf27bf-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-089e8a04-b072-4060-a0dc-563afcbf27bf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "cinder-quobyte-089e8a04-b072-4060-a0dc-563afcbf27bf" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-quobyte-089e8a04-b072-4060-a0dc-563afcbf27bf" acquired by "delete_volume" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a777dd8-6f2c-4948-a439-af12f272996e]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-089e8a04-b072-4060-a0dc-563afcbf27bf {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:57 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.info" returned: 0 in 0.254s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:57 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.info is being set with open permissions: ugo+rw Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:57 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.info Jul 14 21:30:57 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:57 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-089e8a04-b072-4060-a0dc-563afcbf27bf Jul 14 21:30:57 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:57 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.info" returned: 0 in 0.250s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.827s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] Creating offline snapshot b98ed5fc-e25f-4087-8e8f-d4d18187507d of volume 6a830787-663f-4884-bb29-fda1d894e000 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[570b6518-78b0-4194-9504-29fd0059ff57]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:57 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-76995970-f5b0-4ba5-beda-841b70e27327 tempest-CreateVolumesFromSnapshotTest-44635382 None] Create snapshot completed successfully Jul 14 21:30:57 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-089e8a04-b072-4060-a0dc-563afcbf27bf" returned: 0 in 0.367s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-089e8a04-b072-4060-a0dc-563afcbf27bf {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:57 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-089e8a04-b072-4060-a0dc-563afcbf27bf Jul 14 21:30:57 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:57 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 Jul 14 21:30:57 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:58 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-089e8a04-b072-4060-a0dc-563afcbf27bf" returned: 0 in 0.243s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-quobyte-089e8a04-b072-4060-a0dc-563afcbf27bf" released by "delete_volume" :: held 0.648s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] Created reservations ['4a460368-94bc-46dd-a656-1d76dae7f07c', '156eae42-4c2d-476f-ac88-2593c78b8777', 'ef128987-e45c-40a5-97aa-4fc6ac6d3b3e', '505c35a4-b19f-48b3-b08f-160165a40256'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:30:58 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000" returned: 0 in 0.375s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:58 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d 1G Jul 14 21:30:58 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:58 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:30:58 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:58 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.264s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:30:58 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] Deleted volume successfully. Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-2c00d5c1-32b3-4159-89dd-8096de683c6e tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-089e8a04-b072-4060-a0dc-563afcbf27bf-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "cinder-2d8d7bda-45af-4321-bb81-3f5785d29c87-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-2d8d7bda-45af-4321-bb81-3f5785d29c87-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:58 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d 1G" returned: 0 in 0.441s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a830787-663f-4884-bb29-fda1d894e000 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "cinder-quobyte-2d8d7bda-45af-4321-bb81-3f5785d29c87" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-quobyte-2d8d7bda-45af-4321-bb81-3f5785d29c87" acquired by "delete_volume" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:58 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a830787-663f-4884-bb29-fda1d894e000 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d Jul 14 21:30:58 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fc305b-0353-4e2d-8137-2969d70be2e0]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2d8d7bda-45af-4321-bb81-3f5785d29c87 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:58 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2d8d7bda-45af-4321-bb81-3f5785d29c87 Jul 14 21:30:58 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:58 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a830787-663f-4884-bb29-fda1d894e000 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d" returned: 0 in 0.324s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:58 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d is being set with open permissions: ugo+rw Jul 14 21:30:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:58 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d Jul 14 21:30:58 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:59 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2d8d7bda-45af-4321-bb81-3f5785d29c87" returned: 0 in 0.412s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2d8d7bda-45af-4321-bb81-3f5785d29c87 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:59 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2d8d7bda-45af-4321-bb81-3f5785d29c87 Jul 14 21:30:59 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:59 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d" returned: 0 in 0.286s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:59 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.info Jul 14 21:30:59 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Flow 'volume_create_manager' (b6781b48-e591-4702-b1d0-a07e5f1fd981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193aa342-8050-4065-bffe-7b711894e639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193aa342-8050-4065-bffe-7b711894e639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-237862044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=561b67f0-52de-4ea1-a698-149cbeeb10db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae91db5c4f3f4fea8b6be26a3da876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:59Z,use_quota=True,user_id='b54111a40b8c4ec8a021b3d859653cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:59 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b032146d-3711-4c55-a9a9-d3b9ca34090c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b032146d-3711-4c55-a9a9-d3b9ca34090c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea23fd72-097c-4cb3-a209-2d761120440e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea23fd72-097c-4cb3-a209-2d761120440e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '561b67f0-52de-4ea1-a698-149cbeeb10db', 'volume_name': 'volume-561b67f0-52de-4ea1-a698-149cbeeb10db', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253d4b20-3f90-4f2e-a3ca-4ebeecedd683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253d4b20-3f90-4f2e-a3ca-4ebeecedd683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38898bd7-d029-4334-af0c-567893268fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:59 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume 561b67f0-52de-4ea1-a698-149cbeeb10db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-561b67f0-52de-4ea1-a698-149cbeeb10db', 'volume_size': 1} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2d8d7bda-45af-4321-bb81-3f5785d29c87" returned: 0 in 0.331s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-quobyte-2d8d7bda-45af-4321-bb81-3f5785d29c87" released by "delete_volume" :: held 0.779s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] Created reservations ['42c43a73-6c41-49ad-9512-a3412c8e2f6d', '5732ea6f-8400-411c-becf-72a46a258661', 'a8aa1682-52de-4c36-baf7-d559327b722f', '051fda8f-3f4c-4536-ad19-b70009be45cc'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:59 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.info" returned: 0 in 0.337s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:59 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.info is being set with open permissions: ugo+rw Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:30:59 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:30:59 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:59 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.info Jul 14 21:30:59 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Flow 'volume_create_manager' (4b163b64-9992-4264-b993-0801d7a11647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe956833-8a70-4655-afaa-7c9fe1a84963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "cinder-7e7a13a1-4c3a-4981-afc1-2c1c123295af-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe956833-8a70-4655-afaa-7c9fe1a84963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-914680700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c1b3d5-053c-4bae-87cf-074713e1a5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae91db5c4f3f4fea8b6be26a3da876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:00Z,use_quota=True,user_id='b54111a40b8c4ec8a021b3d859653cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254b8248-3c42-458d-ad85-53775a519a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254b8248-3c42-458d-ad85-53775a519a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7118f180-3c1e-4657-9ac5-503bc62b442f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7118f180-3c1e-4657-9ac5-503bc62b442f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c1b3d5-053c-4bae-87cf-074713e1a5d5', 'volume_name': 'volume-61c1b3d5-053c-4bae-87cf-074713e1a5d5', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c18cc17-4792-422f-ba08-56324cf29691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c18cc17-4792-422f-ba08-56324cf29691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6bb8a6-9f74-4104-a998-2fe05f5dbe62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:30:59 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume 61c1b3d5-053c-4bae-87cf-074713e1a5d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c1b3d5-053c-4bae-87cf-074713e1a5d5', 'volume_size': 1} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-7e7a13a1-4c3a-4981-afc1-2c1c123295af-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:59 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.380s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:30:59 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] Deleted volume successfully. Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "cinder-quobyte-7e7a13a1-4c3a-4981-afc1-2c1c123295af" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:30:59 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-quobyte-7e7a13a1-4c3a-4981-afc1-2c1c123295af" acquired by "delete_volume" :: waited 0.022s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:30:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.info" returned: 0 in 0.417s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.304s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d087ee-e779-4eab-9467-05dbcf11d022]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.166s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c3813a-4286-46f9-a39c-586320942ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edef42103ad24b8699c4e972cce55ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:54Z,use_quota=True,user_id='d8f4a6cef42146c0bb3a30007465ebef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9e58785-142c-4494-b554-30fb03c179e8),volume_type_id=c9e58785-142c-4494-b554-30fb03c179e8)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Creating volume 15c3813a-4286-46f9-a39c-586320942ed5 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:00 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7e7a13a1-4c3a-4981-afc1-2c1c123295af {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d226abd0-882d-4f9d-8800-01a3f53ed505 tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-2d8d7bda-45af-4321-bb81-3f5785d29c87-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:00 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 1073741824 Jul 14 21:31:00 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:00 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a93cc003-1bbf-42c0-855f-ab1184d0abea tempest-VolumeDependencyTests-446874483 None] Create snapshot completed successfully Jul 14 21:31:00 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7e7a13a1-4c3a-4981-afc1-2c1c123295af Jul 14 21:31:00 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Flow 'volume_create_manager' (05f18055-95cf-4298-a7df-0a612faff85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (899fcec3-e0db-41c8-a4b5-9ba9710d009f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (899fcec3-e0db-41c8-a4b5-9ba9710d009f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1387931196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4864df08-9959-41cb-90ee-ef7265b6c9a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae91db5c4f3f4fea8b6be26a3da876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:00Z,use_quota=True,user_id='b54111a40b8c4ec8a021b3d859653cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410d9b17-7147-4eca-aed8-7418a768a158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410d9b17-7147-4eca-aed8-7418a768a158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfc6457-c839-4386-88ab-4d5d44d94d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfc6457-c839-4386-88ab-4d5d44d94d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4864df08-9959-41cb-90ee-ef7265b6c9a0', 'volume_name': 'volume-4864df08-9959-41cb-90ee-ef7265b6c9a0', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3655e947-9b38-4e6c-85b8-469f21f9d0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3655e947-9b38-4e6c-85b8-469f21f9d0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a700ac04-5e53-47b0-a7cb-2c0c659285b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:00 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume 4864df08-9959-41cb-90ee-ef7265b6c9a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4864df08-9959-41cb-90ee-ef7265b6c9a0', 'volume_size': 1} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:00 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7e7a13a1-4c3a-4981-afc1-2c1c123295af" returned: 0 in 0.474s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7e7a13a1-4c3a-4981-afc1-2c1c123295af {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:00 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7e7a13a1-4c3a-4981-afc1-2c1c123295af Jul 14 21:31:00 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:00 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 1073741824" returned: 0 in 0.538s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Flow 'volume_create_manager' (99d52b9d-3e26-4e5b-a9eb-d19d47c1f133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b04adb-ae1e-4739-bffa-287d184cfe15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b04adb-ae1e-4739-bffa-287d184cfe15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1163955725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4888600-20ed-4b37-a863-1973c1a4847b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae91db5c4f3f4fea8b6be26a3da876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:01Z,use_quota=True,user_id='b54111a40b8c4ec8a021b3d859653cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea5e946-0018-4724-9920-31ddd9d5b438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea5e946-0018-4724-9920-31ddd9d5b438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c97e36-1b18-49f4-b6e6-d32670d9eb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c97e36-1b18-49f4-b6e6-d32670d9eb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4888600-20ed-4b37-a863-1973c1a4847b', 'volume_name': 'volume-e4888600-20ed-4b37-a863-1973c1a4847b', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5411e180-11ec-49a5-8db1-a9e9bbbfa51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5411e180-11ec-49a5-8db1-a9e9bbbfa51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ffa1c5-5368-4750-a08c-abfb1733d143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:00 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume e4888600-20ed-4b37-a863-1973c1a4847b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4888600-20ed-4b37-a863-1973c1a4847b', 'volume_size': 1} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:00 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 Jul 14 21:31:00 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:00 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7e7a13a1-4c3a-4981-afc1-2c1c123295af" returned: 0 in 0.396s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-quobyte-7e7a13a1-4c3a-4981-afc1-2c1c123295af" released by "delete_volume" :: held 0.974s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:00 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:00 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Flow 'volume_create_manager' (f73ec4ab-5767-44b9-8618-4ff09cc44718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0e6ed3-6561-4cc8-b459-3babdd21bee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5" returned: 0 in 0.336s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.678s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-237862044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=561b67f0-52de-4ea1-a698-149cbeeb10db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae91db5c4f3f4fea8b6be26a3da876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:30:59Z,use_quota=True,user_id='b54111a40b8c4ec8a021b3d859653cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Creating volume 561b67f0-52de-4ea1-a698-149cbeeb10db {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:01 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-561b67f0-52de-4ea1-a698-149cbeeb10db 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0e6ed3-6561-4cc8-b459-3babdd21bee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-704987561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a29c65-2aa9-4229-935b-5be3a66b1ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae91db5c4f3f4fea8b6be26a3da876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:01Z,use_quota=True,user_id='b54111a40b8c4ec8a021b3d859653cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712f1f84-efcc-4046-9fea-9e3b483c0711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:01 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-561b67f0-52de-4ea1-a698-149cbeeb10db 1073741824 Jul 14 21:31:01 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712f1f84-efcc-4046-9fea-9e3b483c0711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094ef738-b91c-4361-a342-b86ffba05653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094ef738-b91c-4361-a342-b86ffba05653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a29c65-2aa9-4229-935b-5be3a66b1ad9', 'volume_name': 'volume-37a29c65-2aa9-4229-935b-5be3a66b1ad9', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ae6a9c-c186-4497-9c91-37dfde73b6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ae6a9c-c186-4497-9c91-37dfde73b6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a340e9-46f4-4815-ac1b-cfc37ba47d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:01 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume 37a29c65-2aa9-4229-935b-5be3a66b1ad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a29c65-2aa9-4229-935b-5be3a66b1ad9', 'volume_size': 1} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] Created reservations ['9897f117-52a9-4b0e-b5a1-09dcf543bfe6', 'ff4ea3dc-d9b5-42f8-b213-0219b8a4565b', 'b2b987e0-5165-44a1-b55c-1a8031c37958', '9ee21c86-e88d-4f26-b59d-de45d1cfd3d2'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Attempting download of 1980be45-f4e9-4f90-858e-5df577a0fa48 ((None, [{'url': 'file:///opt/stack/data/glance/images/1980be45-f4e9-4f90-858e-5df577a0fa48', 'metadata': {}}])) to volume 15c3813a-4286-46f9-a39c-586320942ed5. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40ce369-8d9c-4dac-9bc4-fdccb61578f0]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1980be45-f4e9-4f90-858e-5df577a0fa48_cnimf2us {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:01 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:01 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:01 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1980be45-f4e9-4f90-858e-5df577a0fa48_cnimf2us Jul 14 21:31:01 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:01 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.332s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:01 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] Deleted volume successfully. Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-443f4126-e26a-49a2-a05b-cbd7a17f8000 tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-7e7a13a1-4c3a-4981-afc1-2c1c123295af-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:01 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-561b67f0-52de-4ea1-a698-149cbeeb10db 1073741824" returned: 0 in 0.601s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:01 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1980be45-f4e9-4f90-858e-5df577a0fa48_cnimf2us" returned: 0 in 0.456s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1980be45-f4e9-4f90-858e-5df577a0fa48_cnimf2us {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-561b67f0-52de-4ea1-a698-149cbeeb10db {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:01 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-561b67f0-52de-4ea1-a698-149cbeeb10db Jul 14 21:31:01 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:01 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1980be45-f4e9-4f90-858e-5df577a0fa48_cnimf2us Jul 14 21:31:01 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Flow 'volume_create_manager' (78520947-9f61-4117-87fb-05690b107707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e573fc8-18c9-4c40-8305-61f3bff39e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e573fc8-18c9-4c40-8305-61f3bff39e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-914076560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92a1ca2-6269-455c-9722-8909583d37c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32236c4cc31040bea0651b6e27dfde8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b98ed5fc-e25f-4087-8e8f-d4d18187507d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:02Z,use_quota=True,user_id='6ec048c5c5af4cfea1bc1342c78afa19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a272e7-94f5-4d3a-b822-351a105329ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a272e7-94f5-4d3a-b822-351a105329ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bab8fbc-20d2-4837-928a-58c83d9a3d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bab8fbc-20d2-4837-928a-58c83d9a3d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a92a1ca2-6269-455c-9722-8909583d37c3', 'volume_name': 'volume-a92a1ca2-6269-455c-9722-8909583d37c3', 'volume_size': 1, 'snapshot_id': 'b98ed5fc-e25f-4087-8e8f-d4d18187507d'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fdbb111-20ff-4459-b036-9fc044256ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fdbb111-20ff-4459-b036-9fc044256ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ccf3c7b-5ba0-4340-b74e-f0370a5480dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:01 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Volume a92a1ca2-6269-455c-9722-8909583d37c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a92a1ca2-6269-455c-9722-8909583d37c3', 'volume_size': 1, 'snapshot_id': 'b98ed5fc-e25f-4087-8e8f-d4d18187507d'} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:01 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-561b67f0-52de-4ea1-a698-149cbeeb10db" returned: 0 in 0.266s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.115s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-914680700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c1b3d5-053c-4bae-87cf-074713e1a5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae91db5c4f3f4fea8b6be26a3da876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:00Z,use_quota=True,user_id='b54111a40b8c4ec8a021b3d859653cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Creating volume 61c1b3d5-053c-4bae-87cf-074713e1a5d5 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:01 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c1b3d5-053c-4bae-87cf-074713e1a5d5 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38898bd7-d029-4334-af0c-567893268fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-561b67f0-52de-4ea1-a698-149cbeeb10db', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:02 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:02 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c1b3d5-053c-4bae-87cf-074713e1a5d5 1073741824 Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5b6f79-c1dd-4599-bfbc-c85bd7c65981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:02 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1980be45-f4e9-4f90-858e-5df577a0fa48_cnimf2us" returned: 1 in 0.340s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1980be45-f4e9-4f90-858e-5df577a0fa48_cnimf2us' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "cinder-9cba5656-22a2-4125-a9ce-64755fe3ec33-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5111886-d2c3-4c01-a0df-7fcc3f248f82]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:02 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume volume-561b67f0-52de-4ea1-a698-149cbeeb10db (561b67f0-52de-4ea1-a698-149cbeeb10db): created successfully Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5b6f79-c1dd-4599-bfbc-c85bd7c65981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Flow 'volume_create_manager' (b6781b48-e591-4702-b1d0-a07e5f1fd981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:02 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-39bcab8c-b198-4685-9474-158ff1a156c7 tempest-CreateVolumesFromSnapshotTest-44635382 None] Created volume successfully. Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-9cba5656-22a2-4125-a9ce-64755fe3ec33-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "cinder-quobyte-9cba5656-22a2-4125-a9ce-64755fe3ec33" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-quobyte-9cba5656-22a2-4125-a9ce-64755fe3ec33" acquired by "delete_volume" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:02 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD Jul 14 21:31:02 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[60074991-abe6-4d5c-8b66-d7670682980c]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9cba5656-22a2-4125-a9ce-64755fe3ec33 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:02 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9cba5656-22a2-4125-a9ce-64755fe3ec33 Jul 14 21:31:02 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:02 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:02 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c1b3d5-053c-4bae-87cf-074713e1a5d5 1073741824" returned: 0 in 0.445s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c1b3d5-053c-4bae-87cf-074713e1a5d5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:02 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c1b3d5-053c-4bae-87cf-074713e1a5d5 Jul 14 21:31:02 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:02 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD Jul 14 21:31:02 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:02 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9cba5656-22a2-4125-a9ce-64755fe3ec33" returned: 0 in 0.407s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9cba5656-22a2-4125-a9ce-64755fe3ec33 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:02 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9cba5656-22a2-4125-a9ce-64755fe3ec33 Jul 14 21:31:02 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:02 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c1b3d5-053c-4bae-87cf-074713e1a5d5" returned: 0 in 0.287s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:02 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.440s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1387931196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4864df08-9959-41cb-90ee-ef7265b6c9a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae91db5c4f3f4fea8b6be26a3da876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:00Z,use_quota=True,user_id='b54111a40b8c4ec8a021b3d859653cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Creating volume 4864df08-9959-41cb-90ee-ef7265b6c9a0 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:02 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4864df08-9959-41cb-90ee-ef7265b6c9a0 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD" returned: 1 in 0.387s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6bb8a6-9f74-4104-a998-2fe05f5dbe62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c1b3d5-053c-4bae-87cf-074713e1a5d5', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac23d5d2-1ac4-43b6-ad8b-f03ab13f0663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:02 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4864df08-9959-41cb-90ee-ef7265b6c9a0 1073741824 Jul 14 21:31:02 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] 1980be45-f4e9-4f90-858e-5df577a0fa48 was raw, converting to raw {{(pid=88300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:02 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume volume-61c1b3d5-053c-4bae-87cf-074713e1a5d5 (61c1b3d5-053c-4bae-87cf-074713e1a5d5): created successfully Jul 14 21:31:02 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 Jul 14 21:31:02 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac23d5d2-1ac4-43b6-ad8b-f03ab13f0663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Flow 'volume_create_manager' (4b163b64-9992-4264-b993-0801d7a11647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:02 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-1511e1ce-f2cf-4b05-95a2-d5fb69adf40f tempest-CreateVolumesFromSnapshotTest-44635382 None] Created volume successfully. Jul 14 21:31:02 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9cba5656-22a2-4125-a9ce-64755fe3ec33" returned: 0 in 0.308s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-quobyte-9cba5656-22a2-4125-a9ce-64755fe3ec33" released by "delete_volume" :: held 0.775s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:02 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] Created reservations ['c39c5fe2-22b6-418a-a5d1-55fce34c288e', 'f135dad0-bb8d-4d4a-9a1f-3f2332ae7305', 'b51c6147-bd79-4b1f-90c8-2da7aa3af049', '69970e28-7db5-41ca-8dce-79aae853b93a'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:03 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:03 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:03 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5" returned: 0 in 0.373s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1980be45-f4e9-4f90-858e-5df577a0fa48_uj3t0j_7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:31:03 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Converted 0.00 MB image at 0.00 MB/s Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:03 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 1G Jul 14 21:31:03 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:03 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4864df08-9959-41cb-90ee-ef7265b6c9a0 1073741824" returned: 0 in 0.531s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4864df08-9959-41cb-90ee-ef7265b6c9a0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:03 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.309s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:03 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] Deleted volume successfully. Jul 14 21:31:03 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4864df08-9959-41cb-90ee-ef7265b6c9a0 Jul 14 21:31:03 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fb93f562-1df1-439a-b520-bef25ef6b90e tempest-CreateVolumesFromImageTest-550161816 None] Lock "cinder-9cba5656-22a2-4125-a9ce-64755fe3ec33-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:03 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 1G" returned: 0 in 0.326s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[770188fa-37ef-4153-8585-ec0bda3db8eb]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:03 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4864df08-9959-41cb-90ee-ef7265b6c9a0" returned: 0 in 0.296s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.969s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1163955725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4888600-20ed-4b37-a863-1973c1a4847b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae91db5c4f3f4fea8b6be26a3da876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:01Z,use_quota=True,user_id='b54111a40b8c4ec8a021b3d859653cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Creating volume e4888600-20ed-4b37-a863-1973c1a4847b {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:03 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e4888600-20ed-4b37-a863-1973c1a4847b 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:03 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 Jul 14 21:31:03 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a700ac04-5e53-47b0-a7cb-2c0c659285b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4864df08-9959-41cb-90ee-ef7265b6c9a0', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:03 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e4888600-20ed-4b37-a863-1973c1a4847b 1073741824 Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6201316-99fa-4c03-b4e7-0b1816306864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:03 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:03 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume volume-4864df08-9959-41cb-90ee-ef7265b6c9a0 (4864df08-9959-41cb-90ee-ef7265b6c9a0): created successfully Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6201316-99fa-4c03-b4e7-0b1816306864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:03 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Flow 'volume_create_manager' (05f18055-95cf-4298-a7df-0a612faff85c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:03 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d8783eec-2a78-4ddc-8893-5c9590fca06a tempest-CreateVolumesFromSnapshotTest-44635382 None] Created volume successfully. Jul 14 21:31:04 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5" returned: 0 in 0.454s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:04 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 Jul 14 21:31:04 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:04 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e4888600-20ed-4b37-a863-1973c1a4847b 1073741824" returned: 0 in 0.508s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e4888600-20ed-4b37-a863-1973c1a4847b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:04 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e4888600-20ed-4b37-a863-1973c1a4847b Jul 14 21:31:04 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:04 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5" returned: 1 in 0.405s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Downloaded image 1980be45-f4e9-4f90-858e-5df577a0fa48 ((None, [{'url': 'file:///opt/stack/data/glance/images/1980be45-f4e9-4f90-858e-5df577a0fa48', 'metadata': {}}])) to volume 15c3813a-4286-46f9-a39c-586320942ed5 successfully. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Temporary image 1980be45-f4e9-4f90-858e-5df577a0fa48 for user d8f4a6cef42146c0bb3a30007465ebef is deleted. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Marking volume 15c3813a-4286-46f9-a39c-586320942ed5 as bootable. {{(pid=88300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Copying metadata from image 1980be45-f4e9-4f90-858e-5df577a0fa48 to 15c3813a-4286-46f9-a39c-586320942ed5. {{(pid=88300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Creating volume glance metadata for volume 15c3813a-4286-46f9-a39c-586320942ed5 backed by image 1980be45-f4e9-4f90-858e-5df577a0fa48 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1980be45-f4e9-4f90-858e-5df577a0fa48', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f8b2d22481686a290110aa63a2dcecba', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 21:31:04 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e4888600-20ed-4b37-a863-1973c1a4847b" returned: 0 in 0.294s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.409s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-704987561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a29c65-2aa9-4229-935b-5be3a66b1ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae91db5c4f3f4fea8b6be26a3da876e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:01Z,use_quota=True,user_id='b54111a40b8c4ec8a021b3d859653cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Creating volume 37a29c65-2aa9-4229-935b-5be3a66b1ad9 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:04 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-37a29c65-2aa9-4229-935b-5be3a66b1ad9 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d54851-913f-498e-adb7-97a2599a3495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15c3813a-4286-46f9-a39c-586320942ed5', 'volume_size': 1, 'image_id': '1980be45-f4e9-4f90-858e-5df577a0fa48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1980be45-f4e9-4f90-858e-5df577a0fa48', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f8b2d22481686a290110aa63a2dcecba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'edef42103ad24b8699c4e972cce55ee7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '415a9c63f55466f5c09e5047e1ecdd38ba34bac0b4065d2bad171596e9552b2cd95438c7cd53b4182cd950a9a42b63c9c8bbb7cc8dd3aa5dc7c5dcacc236391b', 'id': '1980be45-f4e9-4f90-858e-5df577a0fa48', 'created_at': datetime.datetime(2026, 7, 14, 19, 30, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 30, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1980be45-f4e9-4f90-858e-5df577a0fa48/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:04 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-37a29c65-2aa9-4229-935b-5be3a66b1ad9 1073741824 Jul 14 21:31:04 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcefa49-5945-4477-ba00-3c4e5284e86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ffa1c5-5368-4750-a08c-abfb1733d143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4888600-20ed-4b37-a863-1973c1a4847b', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf545bc5-11f9-42f8-a970-cccedf56006e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:04 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume volume-e4888600-20ed-4b37-a863-1973c1a4847b (e4888600-20ed-4b37-a863-1973c1a4847b): created successfully Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf545bc5-11f9-42f8-a970-cccedf56006e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Flow 'volume_create_manager' (99d52b9d-3e26-4e5b-a9eb-d19d47c1f133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:04 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Volume volume-15c3813a-4286-46f9-a39c-586320942ed5 (15c3813a-4286-46f9-a39c-586320942ed5): created successfully Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcefa49-5945-4477-ba00-3c4e5284e86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:04 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Flow 'volume_create_manager' (b6553650-01d6-48a4-8377-dcfa586ad744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:04 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-aefca65c-1a48-4cf0-9345-e4207c3210e6 tempest-CreateVolumesFromSnapshotTest-44635382 None] Created volume successfully. Jul 14 21:31:04 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-da0567af-1c00-4553-899e-97ff80188781 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Created volume successfully. Jul 14 21:31:05 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-37a29c65-2aa9-4229-935b-5be3a66b1ad9 1073741824" returned: 0 in 0.472s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-37a29c65-2aa9-4229-935b-5be3a66b1ad9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:05 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-37a29c65-2aa9-4229-935b-5be3a66b1ad9 Jul 14 21:31:05 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:05 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-37a29c65-2aa9-4229-935b-5be3a66b1ad9" returned: 0 in 0.254s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.438s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Acquiring lock "cinder-quobyte-b98ed5fc-e25f-4087-8e8f-d4d18187507d-a92a1ca2-6269-455c-9722-8909583d37c3" by "_create_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a340e9-46f4-4815-ac1b-cfc37ba47d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a29c65-2aa9-4229-935b-5be3a66b1ad9', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6139e733-6459-4322-a7f5-63fca7ba192b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-quobyte-b98ed5fc-e25f-4087-8e8f-d4d18187507d-a92a1ca2-6269-455c-9722-8909583d37c3" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Creating volume a92a1ca2-6269-455c-9722-8909583d37c3 from snapshot b98ed5fc-e25f-4087-8e8f-d4d18187507d {{(pid=88300) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Acquiring lock "cinder-quobyte-a92a1ca2-6269-455c-9722-8909583d37c3" by "_copy_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:05 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Volume volume-37a29c65-2aa9-4229-935b-5be3a66b1ad9 (37a29c65-2aa9-4229-935b-5be3a66b1ad9): created successfully Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6139e733-6459-4322-a7f5-63fca7ba192b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Flow 'volume_create_manager' (f73ec4ab-5767-44b9-8618-4ff09cc44718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:05 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-496605f5-312b-4ccd-af18-d8f6d95622ba tempest-CreateVolumesFromSnapshotTest-44635382 None] Created volume successfully. Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-quobyte-a92a1ca2-6269-455c-9722-8909583d37c3" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] snapshot: b98ed5fc-e25f-4087-8e8f-d4d18187507d, volume: a92a1ca2-6269-455c-9722-8909583d37c3, {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a5653b-ba32-4927-a766-90a002ffbe26]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Acquiring lock "cinder-15c3813a-4286-46f9-a39c-586320942ed5-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Lock "cinder-15c3813a-4286-46f9-a39c-586320942ed5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "cinder-37a29c65-2aa9-4229-935b-5be3a66b1ad9-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-37a29c65-2aa9-4229-935b-5be3a66b1ad9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Acquiring lock "cinder-quobyte-15c3813a-4286-46f9-a39c-586320942ed5" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:05 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d Jul 14 21:31:05 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Lock "cinder-quobyte-15c3813a-4286-46f9-a39c-586320942ed5" acquired by "delete_volume" :: waited 0.039s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "cinder-quobyte-37a29c65-2aa9-4229-935b-5be3a66b1ad9" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-quobyte-37a29c65-2aa9-4229-935b-5be3a66b1ad9" acquired by "delete_volume" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e992f4c6-f2c3-4927-ab5f-bd6f552a1fe1]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c570140-e306-43e2-8508-a431475a723d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-37a29c65-2aa9-4229-935b-5be3a66b1ad9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:05 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 Jul 14 21:31:05 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:05 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-37a29c65-2aa9-4229-935b-5be3a66b1ad9 Jul 14 21:31:05 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:06 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d" returned: 0 in 0.514s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a830787-663f-4884-bb29-fda1d894e000(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Creating direct copy from snapshot {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf523d0-d527-485e-8b38-ce50365bc867]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:06 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 Jul 14 21:31:06 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:06 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5" returned: 0 in 0.435s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:06 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-37a29c65-2aa9-4229-935b-5be3a66b1ad9" returned: 0 in 0.476s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-37a29c65-2aa9-4229-935b-5be3a66b1ad9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:06 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-37a29c65-2aa9-4229-935b-5be3a66b1ad9 Jul 14 21:31:06 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:06 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 Jul 14 21:31:06 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:06 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000" returned: 0 in 0.443s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG cinder.utils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Path /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a92a1ca2-6269-455c-9722-8909583d37c3 not found in is_blk_device check {{(pid=88300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a92a1ca2-6269-455c-9722-8909583d37c3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:06 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a92a1ca2-6269-455c-9722-8909583d37c3 Jul 14 21:31:06 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:06 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-37a29c65-2aa9-4229-935b-5be3a66b1ad9" returned: 0 in 0.304s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-quobyte-37a29c65-2aa9-4229-935b-5be3a66b1ad9" released by "delete_volume" :: held 0.851s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:06 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5" returned: 1 in 0.404s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:06 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5 Jul 14 21:31:06 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] Created reservations ['ea69e0a1-a6ee-4bec-9642-00e6f9d52bb3', 'b5bfe1a8-4c0e-49bf-92aa-301050d54a77', '11238b29-2083-4766-885c-9f44b67b376f', '73a2eead-06e3-4452-a7c9-0dabb8ed957c'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:06 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:06 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:06 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-15c3813a-4286-46f9-a39c-586320942ed5" returned: 0 in 0.319s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:06 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Lock "cinder-quobyte-15c3813a-4286-46f9-a39c-586320942ed5" released by "delete_volume" :: held 1.255s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:07 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Created reservations ['cf2fd2a1-7a7a-460b-a578-e23852b1d455', '343a6e16-2fe3-42fa-9803-52e06f1a1cc1', '9bd9fa3d-6401-4b4d-ae17-42a075f27efa', '47a9c4c2-8809-435a-b191-7e366a738350'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:07 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.325s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:07 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:07 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] Deleted volume successfully. Jul 14 21:31:07 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:07 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e0d69a3f-72d3-46be-b609-5c433cd92bf2 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-37a29c65-2aa9-4229-935b-5be3a66b1ad9-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:07 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.487s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:07 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:07 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Deleted volume successfully. Jul 14 21:31:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea1d30c1-a517-4b41-955f-228705100920 tempest-VolumeAndVolumeTypeFromImageTest-1970471199 None] Lock "cinder-15c3813a-4286-46f9-a39c-586320942ed5-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:08 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "cinder-e4888600-20ed-4b37-a863-1973c1a4847b-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:08 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-e4888600-20ed-4b37-a863-1973c1a4847b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:08 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "cinder-quobyte-e4888600-20ed-4b37-a863-1973c1a4847b" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:08 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-quobyte-e4888600-20ed-4b37-a863-1973c1a4847b" acquired by "delete_volume" :: waited 0.035s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:08 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0912215-f38f-4a56-9891-e7d9194b3ed1]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e4888600-20ed-4b37-a863-1973c1a4847b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:08 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e4888600-20ed-4b37-a863-1973c1a4847b Jul 14 21:31:08 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:09 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e4888600-20ed-4b37-a863-1973c1a4847b" returned: 0 in 0.976s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e4888600-20ed-4b37-a863-1973c1a4847b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:09 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e4888600-20ed-4b37-a863-1973c1a4847b Jul 14 21:31:09 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:09 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e4888600-20ed-4b37-a863-1973c1a4847b" returned: 0 in 0.579s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-quobyte-e4888600-20ed-4b37-a863-1973c1a4847b" released by "delete_volume" :: held 1.667s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:10 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] Created reservations ['232cc3ff-ccaf-45e6-a1d5-42e96d10fa66', '8de24268-2b76-4aae-b790-26a54ef35e69', '0cf1bf39-fb0d-4e2a-9a8d-2fc5f3db113d', 'e0bef3dd-ee63-42a6-9511-26e64fa7c078'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:10 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:10 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:10 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "cinder-4864df08-9959-41cb-90ee-ef7265b6c9a0-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:10 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-4864df08-9959-41cb-90ee-ef7265b6c9a0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:10 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "cinder-quobyte-4864df08-9959-41cb-90ee-ef7265b6c9a0" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:10 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-quobyte-4864df08-9959-41cb-90ee-ef7265b6c9a0" acquired by "delete_volume" :: waited 0.057s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:10 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.656s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:10 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:10 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] Deleted volume successfully. Jul 14 21:31:11 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b9136d-c5ca-4e13-b20d-b1c7621c6f0a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4864df08-9959-41cb-90ee-ef7265b6c9a0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7ee1c83b-fe29-4141-b2d3-73bc03966c2e tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-e4888600-20ed-4b37-a863-1973c1a4847b-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:11 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4864df08-9959-41cb-90ee-ef7265b6c9a0 Jul 14 21:31:11 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:12 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4864df08-9959-41cb-90ee-ef7265b6c9a0" returned: 0 in 1.001s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4864df08-9959-41cb-90ee-ef7265b6c9a0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:12 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4864df08-9959-41cb-90ee-ef7265b6c9a0 Jul 14 21:31:12 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:12 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a92a1ca2-6269-455c-9722-8909583d37c3" returned: 0 in 5.961s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:12 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d65bdde-87ff-463b-b6d3-af5eacd390a8]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:12 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4864df08-9959-41cb-90ee-ef7265b6c9a0" returned: 0 in 0.566s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-quobyte-4864df08-9959-41cb-90ee-ef7265b6c9a0" released by "delete_volume" :: held 1.669s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:12 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 Jul 14 21:31:12 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:12 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] Created reservations ['9b8e243c-7ff5-434e-93a7-0a97f6d18cc7', 'fd2278e2-494f-4da5-874b-5d5bcd12b05b', '0cfa50df-2967-4145-9e35-73ea187d7b6a', '5b6f3b61-11ac-40e3-b4ba-99af7446ed18'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:12 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:12 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:13 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.321s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:13 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] Deleted volume successfully. Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-153d4c73-d5c6-46ea-8349-264779c70681 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-4864df08-9959-41cb-90ee-ef7265b6c9a0-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "cinder-61c1b3d5-053c-4bae-87cf-074713e1a5d5-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-61c1b3d5-053c-4bae-87cf-074713e1a5d5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:13 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000" returned: 0 in 0.792s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Image conversion details: src /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a92a1ca2-6269-455c-9722-8909583d37c3 {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:31:13 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Converted 1024.00 MB image at 171.73 MB/s Jul 14 21:31:13 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a92a1ca2-6269-455c-9722-8909583d37c3 is being set with open permissions: ugo+rw Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a92a1ca2-6269-455c-9722-8909583d37c3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "cinder-quobyte-61c1b3d5-053c-4bae-87cf-074713e1a5d5" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-quobyte-61c1b3d5-053c-4bae-87cf-074713e1a5d5" acquired by "delete_volume" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:13 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a92a1ca2-6269-455c-9722-8909583d37c3 Jul 14 21:31:13 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a439743-591e-4d97-8efd-109ecc4b01fd]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c1b3d5-053c-4bae-87cf-074713e1a5d5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:13 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c1b3d5-053c-4bae-87cf-074713e1a5d5 Jul 14 21:31:13 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:13 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a92a1ca2-6269-455c-9722-8909583d37c3" returned: 0 in 0.296s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-quobyte-a92a1ca2-6269-455c-9722-8909583d37c3" released by "_copy_volume_from_snapshot" :: held 8.169s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-quobyte-b98ed5fc-e25f-4087-8e8f-d4d18187507d-a92a1ca2-6269-455c-9722-8909583d37c3" released by "_create_volume_from_snapshot" :: held 8.239s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.282s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ccf3c7b-5ba0-4340-b74e-f0370a5480dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92a1ca2-6269-455c-9722-8909583d37c3', 'volume_size': 1, 'snapshot_id': 'b98ed5fc-e25f-4087-8e8f-d4d18187507d'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ea8118-bb25-4dd0-91d9-7e2cafbf63a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:13 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Volume volume-a92a1ca2-6269-455c-9722-8909583d37c3 (a92a1ca2-6269-455c-9722-8909583d37c3): created successfully Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ea8118-bb25-4dd0-91d9-7e2cafbf63a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Flow 'volume_create_manager' (78520947-9f61-4117-87fb-05690b107707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:13 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-97a66b63-2520-4b06-a5fb-2512890b63b8 tempest-VolumeDependencyTests-446874483 None] Created volume successfully. Jul 14 21:31:13 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c1b3d5-053c-4bae-87cf-074713e1a5d5" returned: 0 in 0.430s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c1b3d5-053c-4bae-87cf-074713e1a5d5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:13 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c1b3d5-053c-4bae-87cf-074713e1a5d5 Jul 14 21:31:13 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] Acquiring lock "cinder-b98ed5fc-e25f-4087-8e8f-d4d18187507d-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-b98ed5fc-e25f-4087-8e8f-d4d18187507d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] Acquiring lock "cinder-quobyte-6a830787-663f-4884-bb29-fda1d894e000" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-quobyte-6a830787-663f-4884-bb29-fda1d894e000" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] Acquiring lock "cinder-quobyte-b98ed5fc-e25f-4087-8e8f-d4d18187507d" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-quobyte-b98ed5fc-e25f-4087-8e8f-d4d18187507d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:14 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] Deleting offline snapshot b98ed5fc-e25f-4087-8e8f-d4d18187507d of volume 6a830787-663f-4884-bb29-fda1d894e000 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] snapshot_file for this snap is: volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-61c1b3d5-053c-4bae-87cf-074713e1a5d5" returned: 0 in 0.365s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[85514709-8a18-40a5-a925-85df753c0803]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-quobyte-61c1b3d5-053c-4bae-87cf-074713e1a5d5" released by "delete_volume" :: held 0.860s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] Created reservations ['a10f88c4-18eb-439a-958f-240e86b2e4c3', 'b19cfb44-6840-49f3-8c64-6f736fc49fc3', '7a95b35d-bd81-4a03-ba5c-1dd81e3fd134', '28b034ee-7862-467b-a926-876a762e75f6'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:14 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d Jul 14 21:31:14 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:14 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:14 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "cinder-561b67f0-52de-4ea1-a698-149cbeeb10db-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-561b67f0-52de-4ea1-a698-149cbeeb10db-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "cinder-quobyte-561b67f0-52de-4ea1-a698-149cbeeb10db" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-quobyte-561b67f0-52de-4ea1-a698-149cbeeb10db" acquired by "delete_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dc7837-b2d3-45c1-a6d0-17ab2f80ea4b]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-561b67f0-52de-4ea1-a698-149cbeeb10db {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:14 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.352s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:14 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] Deleted volume successfully. Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-9f0bc4f5-fd6a-423a-a74d-9f9c5875ec95 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-61c1b3d5-053c-4bae-87cf-074713e1a5d5-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:14 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-561b67f0-52de-4ea1-a698-149cbeeb10db Jul 14 21:31:14 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:14 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d" returned: 0 in 0.659s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a830787-663f-4884-bb29-fda1d894e000(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeefdfbe-a4f8-4e9e-a044-63d0cf5d8eb6]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:14 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 Jul 14 21:31:14 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:15 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-561b67f0-52de-4ea1-a698-149cbeeb10db" returned: 0 in 0.500s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-561b67f0-52de-4ea1-a698-149cbeeb10db {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:15 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-561b67f0-52de-4ea1-a698-149cbeeb10db Jul 14 21:31:15 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:15 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000" returned: 0 in 0.478s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:15 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-561b67f0-52de-4ea1-a698-149cbeeb10db" returned: 0 in 0.279s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-quobyte-561b67f0-52de-4ea1-a698-149cbeeb10db" released by "delete_volume" :: held 0.841s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:15 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d Jul 14 21:31:15 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] Created reservations ['454c09bf-5ed0-4250-a0df-7d8229029b09', '8fed6837-099b-4d6a-88f2-38eb1e6d836a', '672bc35e-6f6b-4015-b99a-7e6445d4f9b4', 'a3377aa5-7955-4f71-a6f5-a1380a9151cb'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:15 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:15 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "cinder-f92ed097-11d1-4556-aa6d-9539c6403fc7-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-f92ed097-11d1-4556-aa6d-9539c6403fc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "cinder-quobyte-623ec221-4eb9-4338-820f-f92fd9c93a1c" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-quobyte-623ec221-4eb9-4338-820f-f92fd9c93a1c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "cinder-quobyte-f92ed097-11d1-4556-aa6d-9539c6403fc7" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-quobyte-f92ed097-11d1-4556-aa6d-9539c6403fc7" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] Deleting offline snapshot f92ed097-11d1-4556-aa6d-9539c6403fc7 of volume 623ec221-4eb9-4338-820f-f92fd9c93a1c {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:31:15 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:15 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] snapshot_file for this snap is: volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d" returned: 0 in 0.535s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.348s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb672104-0a96-43ac-8e4b-0192b52a6ced]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:15 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d Jul 14 21:31:15 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:15 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] Deleted volume successfully. Jul 14 21:31:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d72c654d-6f5d-42cc-bb3f-6133bf36fddd tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-561b67f0-52de-4ea1-a698-149cbeeb10db-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:16 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7 Jul 14 21:31:16 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:16 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000.b98ed5fc-e25f-4087-8e8f-d4d18187507d" returned: 0 in 0.328s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-quobyte-b98ed5fc-e25f-4087-8e8f-d4d18187507d" released by "_delete_snapshot" :: held 2.133s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-quobyte-6a830787-663f-4884-bb29-fda1d894e000" released by "delete_snapshot" :: held 2.168s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] Created reservations ['343f2c83-2c37-4781-a6da-67b37bda5557', '7b701821-f4db-48f9-bb05-75888efc8b94', '9487cd85-6df2-4c70-abaf-6e2d6c682a65', 'ffc29b12-ae1b-4839-9171-675895155aed'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:16 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7" returned: 0 in 0.515s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623ec221-4eb9-4338-820f-f92fd9c93a1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:31:16 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] Delete snapshot completed successfully. Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[251e18fa-9797-48f6-b0ee-c03247842322]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a609f276-27f6-49e2-b20f-a71aa80278b1 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-b98ed5fc-e25f-4087-8e8f-d4d18187507d-delete_snapshot" released by "delete_snapshot" :: held 2.381s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Flow 'volume_create_manager' (7d20399f-3eaa-4f3c-9257-4e199e76c019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3580f23-c3a7-490d-87eb-6f786df123a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3580f23-c3a7-490d-87eb-6f786df123a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9772561-4d12-468b-8c58-900a1e911f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c213530cd40d44ae95d1d38e7ff5cf72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:16Z,use_quota=True,user_id='20a874ec78f4482db1ce195d11cfd78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3cdb871-4156-47b6-9cff-4327b77bdb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3cdb871-4156-47b6-9cff-4327b77bdb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ee0ed8-5a81-484e-8175-4101f029b046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ee0ed8-5a81-484e-8175-4101f029b046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9772561-4d12-468b-8c58-900a1e911f99', 'volume_name': 'volume-e9772561-4d12-468b-8c58-900a1e911f99', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93841a6d-20b4-40f9-bffb-f6a031eea87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:16 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c Jul 14 21:31:16 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93841a6d-20b4-40f9-bffb-f6a031eea87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177e19a2-e25f-4374-8a60-bb710d5173bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:16 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Volume e9772561-4d12-468b-8c58-900a1e911f99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9772561-4d12-468b-8c58-900a1e911f99', 'volume_size': 1} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9772561-4d12-468b-8c58-900a1e911f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c213530cd40d44ae95d1d38e7ff5cf72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:16Z,use_quota=True,user_id='20a874ec78f4482db1ce195d11cfd78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Creating volume e9772561-4d12-468b-8c58-900a1e911f99 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:16 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e9772561-4d12-468b-8c58-900a1e911f99 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:16 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e9772561-4d12-468b-8c58-900a1e911f99 1073741824 Jul 14 21:31:16 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:16 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c" returned: 0 in 0.402s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:16 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7 Jul 14 21:31:16 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:17 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e9772561-4d12-468b-8c58-900a1e911f99 1073741824" returned: 0 in 0.494s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e9772561-4d12-468b-8c58-900a1e911f99 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:17 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e9772561-4d12-468b-8c58-900a1e911f99 Jul 14 21:31:17 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:17 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7" returned: 0 in 0.397s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:17 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7 Jul 14 21:31:17 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] Acquiring lock "cinder-6a830787-663f-4884-bb29-fda1d894e000-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-6a830787-663f-4884-bb29-fda1d894e000-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] Acquiring lock "cinder-quobyte-6a830787-663f-4884-bb29-fda1d894e000" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-quobyte-6a830787-663f-4884-bb29-fda1d894e000" acquired by "delete_volume" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dd2872-418f-4602-8930-4365afe9ae85]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:17 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e9772561-4d12-468b-8c58-900a1e911f99" returned: 0 in 0.352s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177e19a2-e25f-4374-8a60-bb710d5173bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9772561-4d12-468b-8c58-900a1e911f99', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33abe0ac-74ba-40a2-9c8c-a7ccf4895aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:17 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Volume volume-e9772561-4d12-468b-8c58-900a1e911f99 (e9772561-4d12-468b-8c58-900a1e911f99): created successfully Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33abe0ac-74ba-40a2-9c8c-a7ccf4895aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Flow 'volume_create_manager' (7d20399f-3eaa-4f3c-9257-4e199e76c019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:17 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0a7923c0-cbf4-48a1-a228-41faf17b0419 tempest-CinderUnicodeTest-537481625 None] Created volume successfully. Jul 14 21:31:17 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 Jul 14 21:31:17 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:17 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c.f92ed097-11d1-4556-aa6d-9539c6403fc7" returned: 0 in 0.368s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-quobyte-f92ed097-11d1-4556-aa6d-9539c6403fc7" released by "_delete_snapshot" :: held 1.815s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-quobyte-623ec221-4eb9-4338-820f-f92fd9c93a1c" released by "delete_snapshot" :: held 1.855s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] Created reservations ['468d176d-191b-453d-8d97-2f8e979b616f', 'c3c8a56e-8c4d-48c3-b03a-4f66f371bc56', 'e34833ea-997d-4c8a-85fa-899a02065c63', '744d356a-3763-4686-bf0f-c8d49886661f'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:17 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] Delete snapshot completed successfully. Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a6696653-3912-40d5-83ef-80a192006dd1 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-f92ed097-11d1-4556-aa6d-9539c6403fc7-delete_snapshot" released by "delete_snapshot" :: held 2.037s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:17 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000" returned: 0 in 0.401s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:17 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000 Jul 14 21:31:17 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "cinder-623ec221-4eb9-4338-820f-f92fd9c93a1c-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-623ec221-4eb9-4338-820f-f92fd9c93a1c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "cinder-quobyte-623ec221-4eb9-4338-820f-f92fd9c93a1c" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-quobyte-623ec221-4eb9-4338-820f-f92fd9c93a1c" acquired by "delete_volume" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bd86d4-2fa9-4b70-af8d-5fdb571e0ff8]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:18 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a830787-663f-4884-bb29-fda1d894e000" returned: 0 in 0.294s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-quobyte-6a830787-663f-4884-bb29-fda1d894e000" released by "delete_volume" :: held 0.780s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:18 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c Jul 14 21:31:18 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] Created reservations ['76ede13d-f055-492f-8cc8-9bb2360d3349', '86f21969-20dd-42bf-8406-7ed227b6c597', 'eecd71bf-bc56-4894-aa52-c72056bd1cba', '4a9c4c57-4d99-4143-a003-d9a7b8dd95bb'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:18 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:18 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:18 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c" returned: 0 in 0.440s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] Acquiring lock "cinder-a92a1ca2-6269-455c-9722-8909583d37c3-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:18 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c Jul 14 21:31:18 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-a92a1ca2-6269-455c-9722-8909583d37c3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:18 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] Acquiring lock "cinder-quobyte-a92a1ca2-6269-455c-9722-8909583d37c3" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.360s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:18 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] Deleted volume successfully. Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-quobyte-a92a1ca2-6269-455c-9722-8909583d37c3" acquired by "delete_volume" :: waited 0.038s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-21afcdde-145d-4183-93f7-bf1e9e076ee0 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-6a830787-663f-4884-bb29-fda1d894e000-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0ded15-a970-4145-93cc-53dd9e8bab1e]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a92a1ca2-6269-455c-9722-8909583d37c3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:18 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a92a1ca2-6269-455c-9722-8909583d37c3 Jul 14 21:31:18 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:18 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-623ec221-4eb9-4338-820f-f92fd9c93a1c" returned: 0 in 0.428s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-quobyte-623ec221-4eb9-4338-820f-f92fd9c93a1c" released by "delete_volume" :: held 0.945s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] Created reservations ['6c417342-b347-4ca5-b49f-98267796fce3', '00c2bf50-9738-487e-8387-e946ac73cc9e', 'a000d3cb-77b7-4069-87c1-862e0506282e', 'd6b172c2-4134-4c87-aea9-7d0a593527ae'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:19 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:19 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:19 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a92a1ca2-6269-455c-9722-8909583d37c3" returned: 0 in 0.513s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a92a1ca2-6269-455c-9722-8909583d37c3 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:19 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a92a1ca2-6269-455c-9722-8909583d37c3 Jul 14 21:31:19 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Flow 'volume_create_manager' (d64c7f0f-9a86-485a-a1a3-28624ab46e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf13407-ecb7-4b44-ad79-24d04d71d37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf13407-ecb7-4b44-ad79-24d04d71d37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-478882318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335705d8-b842-430d-8a8f-6ce044b01928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c213530cd40d44ae95d1d38e7ff5cf72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:19Z,use_quota=True,user_id='20a874ec78f4482db1ce195d11cfd78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6e91a5-fda0-4479-885e-0d274152c1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6e91a5-fda0-4479-885e-0d274152c1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b59183a-2308-473d-97eb-1c4aba319fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b59183a-2308-473d-97eb-1c4aba319fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '335705d8-b842-430d-8a8f-6ce044b01928', 'volume_name': 'volume-335705d8-b842-430d-8a8f-6ce044b01928', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ab71e6-85f7-458c-b0eb-85aa1a2562b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ab71e6-85f7-458c-b0eb-85aa1a2562b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7b9fff-9436-4db3-abb7-cad1009cc760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:19 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Volume 335705d8-b842-430d-8a8f-6ce044b01928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-335705d8-b842-430d-8a8f-6ce044b01928', 'volume_size': 1} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-478882318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335705d8-b842-430d-8a8f-6ce044b01928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c213530cd40d44ae95d1d38e7ff5cf72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:19Z,use_quota=True,user_id='20a874ec78f4482db1ce195d11cfd78e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Creating volume 335705d8-b842-430d-8a8f-6ce044b01928 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:19 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:19 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.300s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:19 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] Deleted volume successfully. Jul 14 21:31:19 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928 1073741824 Jul 14 21:31:19 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-84683d4e-8b79-4a20-94c6-dd67f64d1d54 tempest-CreateVolumesFromSnapshotTest-44635382 None] Lock "cinder-623ec221-4eb9-4338-820f-f92fd9c93a1c-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:19 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a92a1ca2-6269-455c-9722-8909583d37c3" returned: 0 in 0.304s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-quobyte-a92a1ca2-6269-455c-9722-8909583d37c3" released by "delete_volume" :: held 0.872s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] Created reservations ['4a628d98-89d7-47be-b9a1-151b9d4101e8', '907e8ffd-8fed-43d6-b001-cd62888fe81c', '87f7de80-bc1b-4056-b15d-04de60a10dd3', '9f71cf2a-3460-433f-aab8-0dfbbbfe45c8'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:19 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:19 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:19 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928 1073741824" returned: 0 in 0.515s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:19 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.310s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:20 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:20 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] Deleted volume successfully. Jul 14 21:31:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c11ffa19-0b74-4302-87c7-fee3c00232c6 tempest-VolumeDependencyTests-446874483 None] Lock "cinder-a92a1ca2-6269-455c-9722-8909583d37c3-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:20 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928 Jul 14 21:31:20 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:20 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928" returned: 0 in 0.266s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7b9fff-9436-4db3-abb7-cad1009cc760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-335705d8-b842-430d-8a8f-6ce044b01928', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8781e33f-5f27-40e2-a3e9-c7dbfe957425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:20 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Volume volume-335705d8-b842-430d-8a8f-6ce044b01928 (335705d8-b842-430d-8a8f-6ce044b01928): created successfully Jul 14 21:31:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8781e33f-5f27-40e2-a3e9-c7dbfe957425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:20 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Flow 'volume_create_manager' (d64c7f0f-9a86-485a-a1a3-28624ab46e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:20 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-c4dfce0f-f2b3-4195-b80c-809b1d88115b tempest-CinderUnicodeTest-537481625 None] Created volume successfully. Jul 14 21:31:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] Creating offline snapshot 41f2d095-959e-4109-9900-272d3a8132ff of volume 335705d8-b842-430d-8a8f-6ce044b01928 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:31:21 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[403b8b50-c203-418a-9ead-0b18e5c50de7]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:21 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928 Jul 14 21:31:21 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:22 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928" returned: 0 in 0.473s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:22 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff 1G Jul 14 21:31:22 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:22 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff 1G" returned: 0 in 0.475s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335705d8-b842-430d-8a8f-6ce044b01928 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:22 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335705d8-b842-430d-8a8f-6ce044b01928 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff Jul 14 21:31:22 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:23 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335705d8-b842-430d-8a8f-6ce044b01928 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff" returned: 0 in 0.330s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:23 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff is being set with open permissions: ugo+rw Jul 14 21:31:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:23 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff Jul 14 21:31:23 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:23 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff" returned: 0 in 0.270s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:23 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.info Jul 14 21:31:23 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:23 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.info" returned: 0 in 0.297s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:23 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.info is being set with open permissions: ugo+rw Jul 14 21:31:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:23 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.info Jul 14 21:31:23 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:24 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.info" returned: 0 in 0.381s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.348s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:24 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-bfb4b5e5-89ea-432b-a34f-cc9cf5fefa92 tempest-CinderUnicodeTest-537481625 None] Create snapshot completed successfully Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Flow 'volume_create_manager' (14cbfbc3-a678-4373-80ca-f223d3a9ee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9131ce-e31e-404f-aa54-814c321cd6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9131ce-e31e-404f-aa54-814c321cd6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-418780215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7821c9f2-c9ee-45a1-a3f5-5476b978f0b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e9aebfc3724797adcd32240fcc9e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:24Z,use_quota=True,user_id='0f4a593def534f14b864f28f4744a31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f18a157-15bc-45cb-91a5-488722632d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f18a157-15bc-45cb-91a5-488722632d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322d2d80-d913-4eb2-a29c-52e936c6adb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322d2d80-d913-4eb2-a29c-52e936c6adb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7821c9f2-c9ee-45a1-a3f5-5476b978f0b0', 'volume_name': 'volume-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e09d62-1fda-4946-862b-519fa44fcd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e09d62-1fda-4946-862b-519fa44fcd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf511e76-073a-4205-b423-219d8d9d760b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:24 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume 7821c9f2-c9ee-45a1-a3f5-5476b978f0b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0', 'volume_size': 1} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-418780215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7821c9f2-c9ee-45a1-a3f5-5476b978f0b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e9aebfc3724797adcd32240fcc9e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:24Z,use_quota=True,user_id='0f4a593def534f14b864f28f4744a31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Creating volume 7821c9f2-c9ee-45a1-a3f5-5476b978f0b0 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:24 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:24 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0 1073741824 Jul 14 21:31:24 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:24 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0 1073741824" returned: 0 in 0.434s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:24 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0 Jul 14 21:31:24 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] Acquiring lock "cinder-41f2d095-959e-4109-9900-272d3a8132ff-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] Lock "cinder-41f2d095-959e-4109-9900-272d3a8132ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] Acquiring lock "cinder-quobyte-335705d8-b842-430d-8a8f-6ce044b01928" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] Lock "cinder-quobyte-335705d8-b842-430d-8a8f-6ce044b01928" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] Acquiring lock "cinder-quobyte-41f2d095-959e-4109-9900-272d3a8132ff" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] Lock "cinder-quobyte-41f2d095-959e-4109-9900-272d3a8132ff" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] Deleting offline snapshot 41f2d095-959e-4109-9900-272d3a8132ff of volume 335705d8-b842-430d-8a8f-6ce044b01928 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] snapshot_file for this snap is: volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f062c1a6-44be-4feb-90eb-231c5377f1d2]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:25 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0" returned: 0 in 0.293s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf511e76-073a-4205-b423-219d8d9d760b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8512fab-7309-4b15-a072-310374056460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:25 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume volume-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0 (7821c9f2-c9ee-45a1-a3f5-5476b978f0b0): created successfully Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8512fab-7309-4b15-a072-310374056460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Flow 'volume_create_manager' (14cbfbc3-a678-4373-80ca-f223d3a9ee72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:25 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff Jul 14 21:31:25 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:25 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2df36729-f237-475b-8bb5-2c993ea80f64 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Created volume successfully. Jul 14 21:31:25 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff" returned: 0 in 0.367s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-335705d8-b842-430d-8a8f-6ce044b01928(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[767c80e7-d83e-42e5-b1d6-d655c0ef68a2]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:25 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928 Jul 14 21:31:25 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:25 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928" returned: 0 in 0.408s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:25 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff Jul 14 21:31:25 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:26 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff" returned: 0 in 0.418s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:26 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff Jul 14 21:31:26 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:26 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928.41f2d095-959e-4109-9900-272d3a8132ff" returned: 0 in 0.278s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] Lock "cinder-quobyte-41f2d095-959e-4109-9900-272d3a8132ff" released by "_delete_snapshot" :: held 1.594s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] Lock "cinder-quobyte-335705d8-b842-430d-8a8f-6ce044b01928" released by "delete_snapshot" :: held 1.619s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Flow 'volume_create_manager' (ad9d5605-9821-45a1-85f0-2ac9814f3cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51f7519-601f-4e87-8f1f-b52e89bcac16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51f7519-601f-4e87-8f1f-b52e89bcac16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96288c6d-0c9f-4c0a-87cd-77cb160fd066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde62ca38efa4d8eb7a7d8f284792a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:27Z,use_quota=True,user_id='dcf9932bb4e94d7b904f1c52c7368422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118dfae0-6f41-4812-9691-2ec22ec3f464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118dfae0-6f41-4812-9691-2ec22ec3f464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516009a3-7415-4512-9b82-15a01de2fcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.image.glance [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Creating Keystone auth plugin from conf {{(pid=88300) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] Created reservations ['bac58efd-0592-4223-9de5-a08d2b099f8e', 'ac3b3319-3dd2-4327-9151-d8420a2f5da6', '9388b343-be8d-4a83-ac33-39c5bec98474', 'eea2470d-7603-468c-b7fe-d8ed7392220d'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:26 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] Delete snapshot completed successfully. Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a8049343-b20c-49ec-9d5e-7f34a387d8d4 tempest-CinderUnicodeTest-537481625 None] Lock "cinder-41f2d095-959e-4109-9900-272d3a8132ff-delete_snapshot" released by "delete_snapshot" :: held 1.858s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Flow 'volume_create_manager' (72b2c660-2fcc-4638-8978-60a956952aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8658c94-25c0-4946-9c48-10b3705e04d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8658c94-25c0-4946-9c48-10b3705e04d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-242036181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591e2151-d363-4c62-847e-f8aefeb582d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e9aebfc3724797adcd32240fcc9e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:27Z,use_quota=True,user_id='0f4a593def534f14b864f28f4744a31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354c65f7-cb48-46e6-84cd-26aaa6b1ceb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:26 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354c65f7-cb48-46e6-84cd-26aaa6b1ceb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d203c187-310a-48a7-854f-1f384042623c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d203c187-310a-48a7-854f-1f384042623c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '591e2151-d363-4c62-847e-f8aefeb582d1', 'volume_name': 'volume-591e2151-d363-4c62-847e-f8aefeb582d1', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6532c458-ecc5-4166-982c-500b2a7966e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6532c458-ecc5-4166-982c-500b2a7966e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07eda1c-fe66-4d0c-ae46-ce9123b65d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:27 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume 591e2151-d363-4c62-847e-f8aefeb582d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-591e2151-d363-4c62-847e-f8aefeb582d1', 'volume_size': 1} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-242036181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591e2151-d363-4c62-847e-f8aefeb582d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e9aebfc3724797adcd32240fcc9e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:27Z,use_quota=True,user_id='0f4a593def534f14b864f28f4744a31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Creating volume 591e2151-d363-4c62-847e-f8aefeb582d1 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:27 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-591e2151-d363-4c62-847e-f8aefeb582d1 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:27 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-591e2151-d363-4c62-847e-f8aefeb582d1 1073741824 Jul 14 21:31:27 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516009a3-7415-4512-9b82-15a01de2fcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '96288c6d-0c9f-4c0a-87cd-77cb160fd066', 'volume_name': 'volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066', 'volume_size': 1, 'image_id': '71378061-8508-4b6d-a7c8-9e1184f5cc13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71378061-8508-4b6d-a7c8-9e1184f5cc13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4938e59062a313cb1e8bc3dbb3bef98', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bde62ca38efa4d8eb7a7d8f284792a10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e5e7f2de074d68f40420ca13bca8514f63eb42e4bb8b3a9912f317bd34b3b4dcbd42d84cce80d0afff8cf6f5cfb346cfaae9935ecfb756764bd2e5a7b37c749b', 'id': '71378061-8508-4b6d-a7c8-9e1184f5cc13', 'created_at': datetime.datetime(2026, 7, 14, 19, 31, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 31, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71378061-8508-4b6d-a7c8-9e1184f5cc13/file', 'properties': {}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add78bab-aba5-47c2-adf1-e71f949b4921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add78bab-aba5-47c2-adf1-e71f949b4921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a81dda24-5af6-4da9-9d28-94c99400ba0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:27 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Volume 96288c6d-0c9f-4c0a-87cd-77cb160fd066: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066', 'volume_size': 1, 'image_id': '71378061-8508-4b6d-a7c8-9e1184f5cc13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71378061-8508-4b6d-a7c8-9e1184f5cc13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4938e59062a313cb1e8bc3dbb3bef98', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bde62ca38efa4d8eb7a7d8f284792a10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e5e7f2de074d68f40420ca13bca8514f63eb42e4bb8b3a9912f317bd34b3b4dcbd42d84cce80d0afff8cf6f5cfb346cfaae9935ecfb756764bd2e5a7b37c749b', 'id': '71378061-8508-4b6d-a7c8-9e1184f5cc13', 'created_at': datetime.datetime(2026, 7, 14, 19, 31, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 31, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71378061-8508-4b6d-a7c8-9e1184f5cc13/file', 'properties': {}}, 'image_service': } Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Trying to clone 96288c6d-0c9f-4c0a-87cd-77cb160fd066 from image 71378061-8508-4b6d-a7c8-9e1184f5cc13 at location (None, [{'url': 'file:///opt/stack/data/glance/images/71378061-8508-4b6d-a7c8-9e1184f5cc13', 'metadata': {}}]). {{(pid=88300) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Flow 'volume_create_manager' (bef9d7af-e63e-486d-b3b0-60e37b2c2d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1732874-de58-4839-9d2d-fb9bd6a962f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 14 21:31:27 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Image download 0.00 MB at 0.00 MB/s Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] Acquiring lock "cinder-335705d8-b842-430d-8a8f-6ce044b01928-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1732874-de58-4839-9d2d-fb9bd6a962f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1887934306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3499da2a-ea18-4577-bc3d-513f86400910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e9aebfc3724797adcd32240fcc9e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:27Z,use_quota=True,user_id='0f4a593def534f14b864f28f4744a31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4805b919-60d6-49ab-bff8-12516fc4377d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4805b919-60d6-49ab-bff8-12516fc4377d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff93a3c-6e12-46b4-acb5-ee83d2684b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff93a3c-6e12-46b4-acb5-ee83d2684b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3499da2a-ea18-4577-bc3d-513f86400910', 'volume_name': 'volume-3499da2a-ea18-4577-bc3d-513f86400910', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b07347e-b3be-456b-a3e6-d73021a92be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b07347e-b3be-456b-a3e6-d73021a92be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeef0058-651f-4a70-8f78-09e3ebe5c825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:27 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume 3499da2a-ea18-4577-bc3d-513f86400910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3499da2a-ea18-4577-bc3d-513f86400910', 'volume_size': 1} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] Lock "cinder-335705d8-b842-430d-8a8f-6ce044b01928-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff816de-7a6f-4fa0-a824-65eaa0fd0533]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] Acquiring lock "cinder-quobyte-335705d8-b842-430d-8a8f-6ce044b01928" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] Lock "cinder-quobyte-335705d8-b842-430d-8a8f-6ce044b01928" acquired by "delete_volume" :: waited 0.050s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c825dd4-7247-4937-98bb-1048a54010ce]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:27 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-591e2151-d363-4c62-847e-f8aefeb582d1 1073741824" returned: 0 in 0.801s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-591e2151-d363-4c62-847e-f8aefeb582d1 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:27 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD Jul 14 21:31:27 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:27 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-591e2151-d363-4c62-847e-f8aefeb582d1 Jul 14 21:31:27 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:27 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Flow 'volume_create_manager' (6ddf252d-4566-417f-b97b-874bcac23cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:28 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928 Jul 14 21:31:28 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71abe6dd-adbb-4093-831b-8af9490f9262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71abe6dd-adbb-4093-831b-8af9490f9262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1476452983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=996a853f-3c0c-4c3d-bb5c-9a90e3121312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e9aebfc3724797adcd32240fcc9e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:28Z,use_quota=True,user_id='0f4a593def534f14b864f28f4744a31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370d4892-bb4b-4454-9910-bf96ab33c98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370d4892-bb4b-4454-9910-bf96ab33c98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740802c4-0b8e-4bca-acc3-cfe5b7276337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740802c4-0b8e-4bca-acc3-cfe5b7276337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '996a853f-3c0c-4c3d-bb5c-9a90e3121312', 'volume_name': 'volume-996a853f-3c0c-4c3d-bb5c-9a90e3121312', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4397d947-2b46-4e92-b9f3-f54bda6cfe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4397d947-2b46-4e92-b9f3-f54bda6cfe18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7f18d9-4298-4700-bf5a-b483cbd4f59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:28 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume 996a853f-3c0c-4c3d-bb5c-9a90e3121312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-996a853f-3c0c-4c3d-bb5c-9a90e3121312', 'volume_size': 1} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:28 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD" returned: 0 in 0.698s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:28 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-591e2151-d363-4c62-847e-f8aefeb582d1" returned: 0 in 0.522s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:28 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1887934306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3499da2a-ea18-4577-bc3d-513f86400910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e9aebfc3724797adcd32240fcc9e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:27Z,use_quota=True,user_id='0f4a593def534f14b864f28f4744a31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Creating volume 3499da2a-ea18-4577-bc3d-513f86400910 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:28 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3499da2a-ea18-4577-bc3d-513f86400910 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928" returned: 0 in 0.654s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:28 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3499da2a-ea18-4577-bc3d-513f86400910 1073741824 Jul 14 21:31:28 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07eda1c-fe66-4d0c-ae46-ce9123b65d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-591e2151-d363-4c62-847e-f8aefeb582d1', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:28 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD Jul 14 21:31:28 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91a8fae-db63-4756-a42d-86bf04edb889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:28 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928 Jul 14 21:31:28 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:28 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume volume-591e2151-d363-4c62-847e-f8aefeb582d1 (591e2151-d363-4c62-847e-f8aefeb582d1): created successfully Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91a8fae-db63-4756-a42d-86bf04edb889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Flow 'volume_create_manager' (72b2c660-2fcc-4638-8978-60a956952aab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:28 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-38c76943-8f95-457e-b363-9421ceba1546 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Created volume successfully. Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Flow 'volume_create_manager' (531269ff-4a26-4f3a-8984-dc0283354a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83744557-6bb4-49c0-8958-96a752759313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83744557-6bb4-49c0-8958-96a752759313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-169841829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94891af0-dfa4-4268-bdc2-16da27369fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e9aebfc3724797adcd32240fcc9e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:28Z,use_quota=True,user_id='0f4a593def534f14b864f28f4744a31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e716189-19df-41ed-9375-fb6def447660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e716189-19df-41ed-9375-fb6def447660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960088b6-1616-4c04-8bc4-9ca4a286fbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960088b6-1616-4c04-8bc4-9ca4a286fbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94891af0-dfa4-4268-bdc2-16da27369fee', 'volume_name': 'volume-94891af0-dfa4-4268-bdc2-16da27369fee', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392d710e-b30d-439d-84b0-3796399eabd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392d710e-b30d-439d-84b0-3796399eabd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1bd548-fbda-4b24-a6cb-7996a5e82636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:28 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume 94891af0-dfa4-4268-bdc2-16da27369fee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94891af0-dfa4-4268-bdc2-16da27369fee', 'volume_size': 1} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:28 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD" returned: 1 in 0.609s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Temporary image 71378061-8508-4b6d-a7c8-9e1184f5cc13 is fetched for user dcf9932bb4e94d7b904f1c52c7368422. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 14 21:31:28 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-335705d8-b842-430d-8a8f-6ce044b01928" returned: 0 in 0.508s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d83e494-28ea-4f12-b968-676d57d4d7c9]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] Lock "cinder-quobyte-335705d8-b842-430d-8a8f-6ce044b01928" released by "delete_volume" :: held 1.303s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] Created reservations ['fc19e520-8a7f-4f43-b987-13c9f71872dc', 'e6e449c6-5744-400e-908f-390a58e9dac6', '3c19dbdb-0736-4fc6-b0e0-22fdc594a01b', '7e8ac4fb-57a4-4eb4-9624-afd32c0d3f14'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:29 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3499da2a-ea18-4577-bc3d-513f86400910 1073741824" returned: 0 in 0.724s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:29 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD Jul 14 21:31:29 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:29 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3499da2a-ea18-4577-bc3d-513f86400910 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:29 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:29 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3499da2a-ea18-4577-bc3d-513f86400910 Jul 14 21:31:29 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Flow 'volume_create_manager' (fbdaaaa4-355e-493a-b404-325b3ea603df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8457fee-01ab-46e5-a100-45fd57ea3617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8457fee-01ab-46e5-a100-45fd57ea3617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1817486369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67e768f6-3b16-4422-9e0b-95823914e817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e9aebfc3724797adcd32240fcc9e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:29Z,use_quota=True,user_id='0f4a593def534f14b864f28f4744a31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571ad71d-910e-4bb3-ac06-6b4179cb7b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571ad71d-910e-4bb3-ac06-6b4179cb7b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7f7a66-a46b-4be5-8680-c6b4eb71f84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7f7a66-a46b-4be5-8680-c6b4eb71f84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67e768f6-3b16-4422-9e0b-95823914e817', 'volume_name': 'volume-67e768f6-3b16-4422-9e0b-95823914e817', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c303d2e4-20b0-4bb5-bfb8-9ff5b596b54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c303d2e4-20b0-4bb5-bfb8-9ff5b596b54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46b0ed4-c1c7-4392-9fd3-0875f5795426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:29 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume 67e768f6-3b16-4422-9e0b-95823914e817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67e768f6-3b16-4422-9e0b-95823914e817', 'volume_size': 1} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:29 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:29 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:29 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD Jul 14 21:31:29 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3499da2a-ea18-4577-bc3d-513f86400910" returned: 0 in 0.293s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.427s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1476452983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=996a853f-3c0c-4c3d-bb5c-9a90e3121312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e9aebfc3724797adcd32240fcc9e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:28Z,use_quota=True,user_id='0f4a593def534f14b864f28f4744a31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Creating volume 996a853f-3c0c-4c3d-bb5c-9a90e3121312 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:29 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-996a853f-3c0c-4c3d-bb5c-9a90e3121312 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:29 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.383s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:29 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-996a853f-3c0c-4c3d-bb5c-9a90e3121312 1073741824 Jul 14 21:31:29 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] Deleted volume successfully. Jul 14 21:31:29 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeef0058-651f-4a70-8f78-09e3ebe5c825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3499da2a-ea18-4577-bc3d-513f86400910', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4c97f5-679c-46e5-824c-423342a468eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:29 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume volume-3499da2a-ea18-4577-bc3d-513f86400910 (3499da2a-ea18-4577-bc3d-513f86400910): created successfully Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4c97f5-679c-46e5-824c-423342a468eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Flow 'volume_create_manager' (bef9d7af-e63e-486d-b3b0-60e37b2c2d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6d9ca03d-bcde-4248-a0a7-8462a6794d9e tempest-CinderUnicodeTest-537481625 None] Lock "cinder-335705d8-b842-430d-8a8f-6ce044b01928-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:29 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-55470b62-5efc-413a-9636-bd5eb1f1acc4 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Created volume successfully. Jul 14 21:31:29 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD" returned: 1 in 0.395s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] Acquiring lock "cinder-e9772561-4d12-468b-8c58-900a1e911f99-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] Lock "cinder-e9772561-4d12-468b-8c58-900a1e911f99-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] Acquiring lock "cinder-quobyte-e9772561-4d12-468b-8c58-900a1e911f99" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] Lock "cinder-quobyte-e9772561-4d12-468b-8c58-900a1e911f99" acquired by "delete_volume" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d957c10-1f6c-44fc-bd7f-2ddd047fb026]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e9772561-4d12-468b-8c58-900a1e911f99 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:30 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-996a853f-3c0c-4c3d-bb5c-9a90e3121312 1073741824" returned: 0 in 0.540s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-996a853f-3c0c-4c3d-bb5c-9a90e3121312 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:30 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e9772561-4d12-468b-8c58-900a1e911f99 Jul 14 21:31:30 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:30 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-996a853f-3c0c-4c3d-bb5c-9a90e3121312 Jul 14 21:31:30 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:30 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-996a853f-3c0c-4c3d-bb5c-9a90e3121312" returned: 0 in 0.306s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.612s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-169841829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94891af0-dfa4-4268-bdc2-16da27369fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e9aebfc3724797adcd32240fcc9e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:28Z,use_quota=True,user_id='0f4a593def534f14b864f28f4744a31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Creating volume 94891af0-dfa4-4268-bdc2-16da27369fee {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:30 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-94891af0-dfa4-4268-bdc2-16da27369fee 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:30 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7f18d9-4298-4700-bf5a-b483cbd4f59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-996a853f-3c0c-4c3d-bb5c-9a90e3121312', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:30 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-94891af0-dfa4-4268-bdc2-16da27369fee 1073741824 Jul 14 21:31:30 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0102ea3-e1aa-4235-80a1-0a0c50f24255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e9772561-4d12-468b-8c58-900a1e911f99" returned: 0 in 0.469s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e9772561-4d12-468b-8c58-900a1e911f99 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:30 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume volume-996a853f-3c0c-4c3d-bb5c-9a90e3121312 (996a853f-3c0c-4c3d-bb5c-9a90e3121312): created successfully Jul 14 21:31:30 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e9772561-4d12-468b-8c58-900a1e911f99 Jul 14 21:31:30 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0102ea3-e1aa-4235-80a1-0a0c50f24255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Flow 'volume_create_manager' (6ddf252d-4566-417f-b97b-874bcac23cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:30 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-666ca4f5-14f7-4693-8951-48e2b5002228 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Created volume successfully. Jul 14 21:31:30 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e9772561-4d12-468b-8c58-900a1e911f99" returned: 0 in 0.274s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] Lock "cinder-quobyte-e9772561-4d12-468b-8c58-900a1e911f99" released by "delete_volume" :: held 0.786s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] Created reservations ['2c988c8c-d676-4702-a5b7-591f2c616a4f', 'ee0417fd-0177-4418-8768-a64b92496b99', '5f97852e-06ca-4b3c-a57a-58ff93474f76', 'ac28da25-d770-4a45-b3fb-75beb52c9056'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:30 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-94891af0-dfa4-4268-bdc2-16da27369fee 1073741824" returned: 0 in 0.480s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:30 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:30 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-94891af0-dfa4-4268-bdc2-16da27369fee {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:31 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-94891af0-dfa4-4268-bdc2-16da27369fee Jul 14 21:31:31 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:31 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.289s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:31 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] Deleted volume successfully. Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-fbba0d94-a1b2-4d4c-acf1-6ff7a454480c tempest-CinderUnicodeTest-537481625 None] Lock "cinder-e9772561-4d12-468b-8c58-900a1e911f99-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:31 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-94891af0-dfa4-4268-bdc2-16da27369fee" returned: 0 in 0.292s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.913s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1817486369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67e768f6-3b16-4422-9e0b-95823914e817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e9aebfc3724797adcd32240fcc9e84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:29Z,use_quota=True,user_id='0f4a593def534f14b864f28f4744a31a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Creating volume 67e768f6-3b16-4422-9e0b-95823914e817 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:31 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-67e768f6-3b16-4422-9e0b-95823914e817 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1bd548-fbda-4b24-a6cb-7996a5e82636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94891af0-dfa4-4268-bdc2-16da27369fee', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ee981f-61fa-440b-9001-d75361b04d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:31 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-67e768f6-3b16-4422-9e0b-95823914e817 1073741824 Jul 14 21:31:31 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:31 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume volume-94891af0-dfa4-4268-bdc2-16da27369fee (94891af0-dfa4-4268-bdc2-16da27369fee): created successfully Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ee981f-61fa-440b-9001-d75361b04d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Flow 'volume_create_manager' (531269ff-4a26-4f3a-8984-dc0283354a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:31 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-3c403374-7a44-4230-bb57-cd023202fc7c tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Created volume successfully. Jul 14 21:31:31 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-67e768f6-3b16-4422-9e0b-95823914e817 1073741824" returned: 0 in 0.534s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-67e768f6-3b16-4422-9e0b-95823914e817 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:31 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-67e768f6-3b16-4422-9e0b-95823914e817 Jul 14 21:31:31 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:32 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-67e768f6-3b16-4422-9e0b-95823914e817" returned: 0 in 0.281s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.361s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96288c6d-0c9f-4c0a-87cd-77cb160fd066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde62ca38efa4d8eb7a7d8f284792a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:27Z,use_quota=True,user_id='dcf9932bb4e94d7b904f1c52c7368422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Creating volume 96288c6d-0c9f-4c0a-87cd-77cb160fd066 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:32 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46b0ed4-c1c7-4392-9fd3-0875f5795426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67e768f6-3b16-4422-9e0b-95823914e817', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb6f585-7a79-4499-bd6b-f67f1982fdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:32 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 1073741824 Jul 14 21:31:32 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:32 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Volume volume-67e768f6-3b16-4422-9e0b-95823914e817 (67e768f6-3b16-4422-9e0b-95823914e817): created successfully Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb6f585-7a79-4499-bd6b-f67f1982fdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Flow 'volume_create_manager' (fbdaaaa4-355e-493a-b404-325b3ea603df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:32 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-df0bf154-0b05-4c36-b08d-87645c5fcd76 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Created volume successfully. Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "cinder-67e768f6-3b16-4422-9e0b-95823914e817-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-67e768f6-3b16-4422-9e0b-95823914e817-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "cinder-quobyte-67e768f6-3b16-4422-9e0b-95823914e817" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:32 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 1073741824" returned: 0 in 0.617s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-quobyte-67e768f6-3b16-4422-9e0b-95823914e817" acquired by "delete_volume" :: waited 0.043s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc08fef-93c0-481b-82fe-36038c5c55c0]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-67e768f6-3b16-4422-9e0b-95823914e817 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:32 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 Jul 14 21:31:32 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:33 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-67e768f6-3b16-4422-9e0b-95823914e817 Jul 14 21:31:33 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:33 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066" returned: 0 in 0.392s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Attempting download of 71378061-8508-4b6d-a7c8-9e1184f5cc13 ((None, [{'url': 'file:///opt/stack/data/glance/images/71378061-8508-4b6d-a7c8-9e1184f5cc13', 'metadata': {}}])) to volume 96288c6d-0c9f-4c0a-87cd-77cb160fd066. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 14 21:31:33 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-67e768f6-3b16-4422-9e0b-95823914e817" returned: 0 in 0.472s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-67e768f6-3b16-4422-9e0b-95823914e817 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:33 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-67e768f6-3b16-4422-9e0b-95823914e817 Jul 14 21:31:33 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[df243d9f-b10b-413a-86bd-b8905cc08f64]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71378061-8508-4b6d-a7c8-9e1184f5cc13_1kzs1n3r {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:33 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71378061-8508-4b6d-a7c8-9e1184f5cc13_1kzs1n3r Jul 14 21:31:33 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:33 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-67e768f6-3b16-4422-9e0b-95823914e817" returned: 0 in 0.310s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-quobyte-67e768f6-3b16-4422-9e0b-95823914e817" released by "delete_volume" :: held 0.841s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Created reservations ['e0dd21df-6fde-41d3-9ab3-d28d4085e0bd', 'cd167b9b-5ebe-488f-8828-516531ea2750', '9855f5c0-1132-48d4-8e12-1abe047d12f3', '6b3dbfd0-ad99-4337-ab79-95b0f5c9d20f'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:33 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71378061-8508-4b6d-a7c8-9e1184f5cc13_1kzs1n3r" returned: 0 in 0.381s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71378061-8508-4b6d-a7c8-9e1184f5cc13_1kzs1n3r {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:33 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "cinder-94891af0-dfa4-4268-bdc2-16da27369fee-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:33 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:33 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71378061-8508-4b6d-a7c8-9e1184f5cc13_1kzs1n3r Jul 14 21:31:33 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-94891af0-dfa4-4268-bdc2-16da27369fee-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "cinder-quobyte-94891af0-dfa4-4268-bdc2-16da27369fee" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-quobyte-94891af0-dfa4-4268-bdc2-16da27369fee" acquired by "delete_volume" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f678bd1f-9f64-42f1-bed8-dee8defa6de5]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-94891af0-dfa4-4268-bdc2-16da27369fee {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:34 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-94891af0-dfa4-4268-bdc2-16da27369fee Jul 14 21:31:34 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:34 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:34 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71378061-8508-4b6d-a7c8-9e1184f5cc13_1kzs1n3r" returned: 1 in 0.394s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71378061-8508-4b6d-a7c8-9e1184f5cc13_1kzs1n3r' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.329s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fea61c7-e35f-4e0a-a6ab-d26e8306c9be]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:34 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Deleted volume successfully. Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-966782c1-b333-40f6-a096-f0d7cba3535b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-67e768f6-3b16-4422-9e0b-95823914e817-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:34 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD Jul 14 21:31:34 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:34 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-94891af0-dfa4-4268-bdc2-16da27369fee" returned: 0 in 0.429s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-94891af0-dfa4-4268-bdc2-16da27369fee {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:34 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-94891af0-dfa4-4268-bdc2-16da27369fee Jul 14 21:31:34 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:34 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:34 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD Jul 14 21:31:34 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:34 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-94891af0-dfa4-4268-bdc2-16da27369fee" returned: 0 in 0.328s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-quobyte-94891af0-dfa4-4268-bdc2-16da27369fee" released by "delete_volume" :: held 0.813s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Created reservations ['8311979a-5e45-4874-8ecc-c65faa77fa88', 'a29b60d3-5b35-431a-973e-c8d62dab5004', 'cfa50b64-3b24-40da-865c-a10acb7bf034', 'e6a50821-5e0b-4e52-9524-c688d27c85e7'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:34 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] 71378061-8508-4b6d-a7c8-9e1184f5cc13 was raw, converting to raw {{(pid=88300) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 14 21:31:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:35 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 Jul 14 21:31:35 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:35 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:35 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "cinder-996a853f-3c0c-4c3d-bb5c-9a90e3121312-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-996a853f-3c0c-4c3d-bb5c-9a90e3121312-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "cinder-quobyte-996a853f-3c0c-4c3d-bb5c-9a90e3121312" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-quobyte-996a853f-3c0c-4c3d-bb5c-9a90e3121312" acquired by "delete_volume" :: waited 0.026s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[54342f52-59ab-464e-9d54-b7c6ce599680]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-996a853f-3c0c-4c3d-bb5c-9a90e3121312 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:35 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.350s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:35 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Deleted volume successfully. Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b39f86d6-eed0-4c1e-9410-4751a136f776 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-94891af0-dfa4-4268-bdc2-16da27369fee-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:35 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066" returned: 0 in 0.539s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71378061-8508-4b6d-a7c8-9e1184f5cc13_tetii89idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:31:35 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Converted 0.00 MB image at 0.00 MB/s Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:35 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-996a853f-3c0c-4c3d-bb5c-9a90e3121312 Jul 14 21:31:35 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:35 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 1G Jul 14 21:31:35 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:35 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-996a853f-3c0c-4c3d-bb5c-9a90e3121312" returned: 0 in 0.498s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-996a853f-3c0c-4c3d-bb5c-9a90e3121312 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:35 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 1G" returned: 0 in 0.334s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:35 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-996a853f-3c0c-4c3d-bb5c-9a90e3121312 Jul 14 21:31:35 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11d3c6d-cf5d-4dfd-ae1c-3f7f330858fe]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:36 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 Jul 14 21:31:36 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:36 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-996a853f-3c0c-4c3d-bb5c-9a90e3121312" returned: 0 in 0.256s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-quobyte-996a853f-3c0c-4c3d-bb5c-9a90e3121312" released by "delete_volume" :: held 0.821s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Created reservations ['438cbe02-1815-446d-a3be-ed2924e5a8ff', 'c81486a1-4742-4864-98dd-47b2137a995b', '92dca9a5-c12b-4c5f-88c7-2d2f20eb5e4b', 'c8e2ff79-1bdb-4f89-bf21-8a65e6e4e12c'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:36 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066" returned: 0 in 0.421s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:36 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:36 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "cinder-3499da2a-ea18-4577-bc3d-513f86400910-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (d8b6d726-d187-43ee-b11e-08c9b6910d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36c6d7e-99f7-47e0-9070-376d5dfdd814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-3499da2a-ea18-4577-bc3d-513f86400910-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36c6d7e-99f7-47e0-9070-376d5dfdd814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1513334579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c5b9262-ee3a-4a24-ac3c-7979eff07195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:36Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c05f3e9-97de-455b-a02c-8579b102958f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c05f3e9-97de-455b-a02c-8579b102958f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4535265-2434-4249-b505-5de8e5da4703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4535265-2434-4249-b505-5de8e5da4703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c5b9262-ee3a-4a24-ac3c-7979eff07195', 'volume_name': 'volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (214bd8e1-16b4-43d9-be3c-b6847506f88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (214bd8e1-16b4-43d9-be3c-b6847506f88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b5c28e-ee66-483e-8e32-5f9d4d554768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:36 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Volume 0c5b9262-ee3a-4a24-ac3c-7979eff07195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195', 'volume_size': 1} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1513334579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c5b9262-ee3a-4a24-ac3c-7979eff07195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:36Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Creating volume 0c5b9262-ee3a-4a24-ac3c-7979eff07195 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:36 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 Jul 14 21:31:36 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:36 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:36 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195 1073741824 Jul 14 21:31:36 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "cinder-quobyte-3499da2a-ea18-4577-bc3d-513f86400910" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-quobyte-3499da2a-ea18-4577-bc3d-513f86400910" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:36 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fec91f-7d18-49e8-be5e-e7f69ab58e5c]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3499da2a-ea18-4577-bc3d-513f86400910 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.362s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:36 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:36 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:36 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Deleted volume successfully. Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5fa7153b-54b3-4cf0-9fd5-8b747d8b11dc tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-996a853f-3c0c-4c3d-bb5c-9a90e3121312-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:36 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3499da2a-ea18-4577-bc3d-513f86400910 Jul 14 21:31:36 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:36 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066" returned: 1 in 0.552s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Downloaded image 71378061-8508-4b6d-a7c8-9e1184f5cc13 ((None, [{'url': 'file:///opt/stack/data/glance/images/71378061-8508-4b6d-a7c8-9e1184f5cc13', 'metadata': {}}])) to volume 96288c6d-0c9f-4c0a-87cd-77cb160fd066 successfully. {{(pid=88300) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Temporary image 71378061-8508-4b6d-a7c8-9e1184f5cc13 for user dcf9932bb4e94d7b904f1c52c7368422 is deleted. {{(pid=88300) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.volume_utils [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Marking volume 96288c6d-0c9f-4c0a-87cd-77cb160fd066 as bootable. {{(pid=88300) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Copying metadata from image 71378061-8508-4b6d-a7c8-9e1184f5cc13 to 96288c6d-0c9f-4c0a-87cd-77cb160fd066. {{(pid=88300) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 14 21:31:36 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Creating volume glance metadata for volume 96288c6d-0c9f-4c0a-87cd-77cb160fd066 backed by image 71378061-8508-4b6d-a7c8-9e1184f5cc13 with: {'image_id': '71378061-8508-4b6d-a7c8-9e1184f5cc13', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e4938e59062a313cb1e8bc3dbb3bef98', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88300) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a81dda24-5af6-4da9-9d28-94c99400ba0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066', 'volume_size': 1, 'image_id': '71378061-8508-4b6d-a7c8-9e1184f5cc13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71378061-8508-4b6d-a7c8-9e1184f5cc13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4938e59062a313cb1e8bc3dbb3bef98', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bde62ca38efa4d8eb7a7d8f284792a10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e5e7f2de074d68f40420ca13bca8514f63eb42e4bb8b3a9912f317bd34b3b4dcbd42d84cce80d0afff8cf6f5cfb346cfaae9935ecfb756764bd2e5a7b37c749b', 'id': '71378061-8508-4b6d-a7c8-9e1184f5cc13', 'created_at': datetime.datetime(2026, 7, 14, 19, 31, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 19, 31, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71378061-8508-4b6d-a7c8-9e1184f5cc13/file', 'properties': {}}, 'image_service': }' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7384774f-2496-4609-ac0c-4df7674f050f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:37 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.412s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 28 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:31:37 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Volume volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 (96288c6d-0c9f-4c0a-87cd-77cb160fd066): created successfully Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7384774f-2496-4609-ac0c-4df7674f050f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Flow 'volume_create_manager' (ad9d5605-9821-45a1-85f0-2ac9814f3cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:37 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-1dff3f3a-a51d-4b9a-bd93-404ce99f0683 tempest-VolumeImageDependencyTests-1241823674 None] Created volume successfully. Jul 14 21:31:37 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3499da2a-ea18-4577-bc3d-513f86400910" returned: 0 in 0.502s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3499da2a-ea18-4577-bc3d-513f86400910 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:37 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195 1073741824" returned: 0 in 0.681s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:37 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3499da2a-ea18-4577-bc3d-513f86400910 Jul 14 21:31:37 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:37 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195 Jul 14 21:31:37 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:37 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3499da2a-ea18-4577-bc3d-513f86400910" returned: 0 in 0.286s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-quobyte-3499da2a-ea18-4577-bc3d-513f86400910" released by "delete_volume" :: held 0.897s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:37 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195" returned: 0 in 0.289s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b5c28e-ee66-483e-8e32-5f9d4d554768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5572b05-c123-44e7-8c49-133ef505b1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Created reservations ['4b4fb812-368d-4305-bce1-0b4d76b58666', '7202c49f-7a99-4f64-9131-4cbbaba05d66', 'b1cf120f-baa5-4e59-9111-30e15498a596', 'cb4dc52e-9939-4190-a135-0305ec938df5'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:37 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Volume volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195 (0c5b9262-ee3a-4a24-ac3c-7979eff07195): created successfully Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5572b05-c123-44e7-8c49-133ef505b1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (d8b6d726-d187-43ee-b11e-08c9b6910d7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:37 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-57552607-05be-4f4f-befd-c26bcc4a7b5d tempest-ProjectMemberTests-1217057865 None] Created volume successfully. Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:37 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:37 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Acquiring lock "cinder-96288c6d-0c9f-4c0a-87cd-77cb160fd066-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Lock "cinder-96288c6d-0c9f-4c0a-87cd-77cb160fd066-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Acquiring lock "cinder-quobyte-96288c6d-0c9f-4c0a-87cd-77cb160fd066" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Lock "cinder-quobyte-96288c6d-0c9f-4c0a-87cd-77cb160fd066" acquired by "delete_volume" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:37 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.341s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:37 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Deleted volume successfully. Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[953207c5-ebd1-4c22-a3fd-4744bb849a89]: (4, 'raw') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:38 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e2dc9b0a-410f-4058-86a1-89f680ebf534 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-3499da2a-ea18-4577-bc3d-513f86400910-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:38 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 Jul 14 21:31:38 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:38 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066" returned: 0 in 0.387s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:38 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 Jul 14 21:31:38 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:38 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "cinder-591e2151-d363-4c62-847e-f8aefeb582d1-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:38 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-591e2151-d363-4c62-847e-f8aefeb582d1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:38 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "cinder-quobyte-591e2151-d363-4c62-847e-f8aefeb582d1" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:38 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-quobyte-591e2151-d363-4c62-847e-f8aefeb582d1" acquired by "delete_volume" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:38 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066" returned: 1 in 0.464s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066' failed. Not Retrying. {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 14 21:31:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:38 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9556677e-3f93-4565-bec6-907abfc6ab0d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-591e2151-d363-4c62-847e-f8aefeb582d1 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:38 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066 Jul 14 21:31:38 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] Creating offline snapshot a9cfc15f-f946-4914-9e36-f5ad5f350b5f of volume 0c5b9262-ee3a-4a24-ac3c-7979eff07195 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:31:38 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce03282-9241-4253-8fb0-48cd60d5cb75]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:38 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-591e2151-d363-4c62-847e-f8aefeb582d1 Jul 14 21:31:38 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:39 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195 Jul 14 21:31:39 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:39 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-96288c6d-0c9f-4c0a-87cd-77cb160fd066" returned: 0 in 0.331s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Lock "cinder-quobyte-96288c6d-0c9f-4c0a-87cd-77cb160fd066" released by "delete_volume" :: held 1.254s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Created reservations ['3fbc08ec-1384-4e69-adfc-6287bdae535e', '73cd1e9c-b3fc-4a7e-ba67-9c81a7d72ab1', 'f8a509a2-3194-44d5-81a5-6b66d1e60783', '7aa225bd-b0bc-4bff-8b33-4ab6c1551076'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:39 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-591e2151-d363-4c62-847e-f8aefeb582d1" returned: 0 in 0.458s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-591e2151-d363-4c62-847e-f8aefeb582d1 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:39 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-591e2151-d363-4c62-847e-f8aefeb582d1 Jul 14 21:31:39 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:39 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:39 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:39 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195" returned: 0 in 0.453s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:39 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f 1G Jul 14 21:31:39 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:39 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.260s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:39 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:39 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Deleted volume successfully. Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-591e2151-d363-4c62-847e-f8aefeb582d1" returned: 0 in 0.322s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-quobyte-591e2151-d363-4c62-847e-f8aefeb582d1" released by "delete_volume" :: held 0.859s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f90e3d6c-9d2e-48e6-ab15-7f02c77913ff tempest-VolumeImageDependencyTests-1241823674 None] Lock "cinder-96288c6d-0c9f-4c0a-87cd-77cb160fd066-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Created reservations ['527ec8ae-b743-44ad-9519-51e6fa9b0393', 'fb6aa766-fdb8-4162-ad24-b48002d72ccd', '8b2fe9a8-ff2b-4014-964b-c9b02dcfe003', '2225b562-07d5-40a5-b246-04bd37080b39'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:39 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:39 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "cinder-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:39 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f 1G" returned: 0 in 0.517s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:39 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f Jul 14 21:31:39 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "cinder-quobyte-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-quobyte-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0" acquired by "delete_volume" :: waited 0.028s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:40 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9124ea-fbc7-4573-8fc1-621d59262740]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:40 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0 Jul 14 21:31:40 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:40 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.463s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:40 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:40 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Deleted volume successfully. Jul 14 21:31:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-50a9b068-f328-48aa-b557-e8f22377b27b tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-591e2151-d363-4c62-847e-f8aefeb582d1-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:40 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f" returned: 0 in 0.439s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:40 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f is being set with open permissions: ugo+rw Jul 14 21:31:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:40 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f Jul 14 21:31:40 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:40 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0" returned: 0 in 0.593s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:40 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0 Jul 14 21:31:40 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:40 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f" returned: 0 in 0.338s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:40 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.info Jul 14 21:31:40 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:40 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0" returned: 0 in 0.336s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-quobyte-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0" released by "delete_volume" :: held 0.979s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:41 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Created reservations ['59492a8f-53c5-4875-b1c7-bd6728159f2c', '3a4e0b04-9f8d-4989-9b97-8ceb6ebe580e', '1b4668da-e7d7-4be9-bc8a-504a4a35f307', '6705354c-2c00-4b64-b53d-69f2e054155c'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:41 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.info" returned: 0 in 0.346s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:41 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.info is being set with open permissions: ugo+rw Jul 14 21:31:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:41 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.info Jul 14 21:31:41 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:41 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:41 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:41 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.info" returned: 0 in 0.324s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:41 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.552s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.300s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:41 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:41 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Deleted volume successfully. Jul 14 21:31:41 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d96b2a54-2a90-4075-99aa-22b3a2a0de5e tempest-ProjectMemberTests-1217057865 None] Create snapshot completed successfully Jul 14 21:31:41 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-e06d45e5-35d9-4f72-a75f-c25ca5330288 tempest-CreateVolumesFromSourceVolumeTest-1260312027 None] Lock "cinder-7821c9f2-c9ee-45a1-a3f5-5476b978f0b0-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-a9cfc15f-f946-4914-9e36-f5ad5f350b5f-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-a9cfc15f-f946-4914-9e36-f5ad5f350b5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-0c5b9262-ee3a-4a24-ac3c-7979eff07195" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-0c5b9262-ee3a-4a24-ac3c-7979eff07195" acquired by "delete_snapshot" :: waited 0.081s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-a9cfc15f-f946-4914-9e36-f5ad5f350b5f" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:42 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-a9cfc15f-f946-4914-9e36-f5ad5f350b5f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:42 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] Deleting offline snapshot a9cfc15f-f946-4914-9e36-f5ad5f350b5f of volume 0c5b9262-ee3a-4a24-ac3c-7979eff07195 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:31:42 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] snapshot_file for this snap is: volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:31:42 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb8b55d-bdc9-47d2-af29-b02c25512d44]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:42 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f Jul 14 21:31:42 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:42 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f" returned: 0 in 0.506s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:42 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:31:42 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4040e4b2-787f-414e-a39d-b3dabfd209b6]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:43 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195 Jul 14 21:31:43 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:43 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195" returned: 0 in 0.557s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:43 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f Jul 14 21:31:43 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:43 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f" returned: 0 in 0.519s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:43 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f Jul 14 21:31:43 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:44 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195.a9cfc15f-f946-4914-9e36-f5ad5f350b5f" returned: 0 in 0.260s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-a9cfc15f-f946-4914-9e36-f5ad5f350b5f" released by "_delete_snapshot" :: held 2.003s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-0c5b9262-ee3a-4a24-ac3c-7979eff07195" released by "delete_snapshot" :: held 2.026s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:44 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] Created reservations ['5e6ee9a7-ca72-4782-8e11-7afb2279bc06', '056c6e2d-d367-4d4e-a454-94d8fee3a741', '697fafb5-46f7-411b-8cb1-5d67b1d13408', '5c63e87e-cfed-445a-8d34-0ddb98c1061e'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:44 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] Delete snapshot completed successfully. Jul 14 21:31:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f81c02ed-9f06-4e4e-a163-c3332bdf02f5 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-a9cfc15f-f946-4914-9e36-f5ad5f350b5f-delete_snapshot" released by "delete_snapshot" :: held 2.272s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:44 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-74d4c4e4-876a-4489-8742-512594d04e54 tempest-ProjectAdminTests-1911871439 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88300) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 14 21:31:45 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-0c5b9262-ee3a-4a24-ac3c-7979eff07195-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:45 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-0c5b9262-ee3a-4a24-ac3c-7979eff07195-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:45 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-0c5b9262-ee3a-4a24-ac3c-7979eff07195" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:45 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-0c5b9262-ee3a-4a24-ac3c-7979eff07195" acquired by "delete_volume" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:45 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e761c3f-4435-4fe9-b52a-233d7b6aeef9]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:45 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195 Jul 14 21:31:45 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:45 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195" returned: 0 in 0.439s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:45 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195 Jul 14 21:31:45 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:46 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-0c5b9262-ee3a-4a24-ac3c-7979eff07195" returned: 0 in 0.312s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-0c5b9262-ee3a-4a24-ac3c-7979eff07195" released by "delete_volume" :: held 0.834s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:46 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] Created reservations ['20ca2c6b-4533-422d-ba03-20aa24784bc2', '5934f90c-d860-4d4e-b5dd-885394fc10c5', 'b5e6bbb9-5006-449c-9808-4897c1aad780', '274c86b8-5805-4c60-a1f1-098d13b0e760'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:46 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:46 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:46 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:46 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:46 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.315s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:46 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:46 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] Deleted volume successfully. Jul 14 21:31:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-eec3f747-8730-4744-b6b5-f38a2884e525 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-0c5b9262-ee3a-4a24-ac3c-7979eff07195-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (09a00c5b-82c7-4a96-b75b-3718da4ac582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0f6d1b-c574-466d-8c39-3d6519597c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0f6d1b-c574-466d-8c39-3d6519597c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-834428999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40c0ba9-1430-4a2e-bcbb-7beac7422597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:47Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841fc955-1230-45a5-bda9-60804427a1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841fc955-1230-45a5-bda9-60804427a1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e613f53-7367-4764-979f-12f5046b687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e613f53-7367-4764-979f-12f5046b687a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f40c0ba9-1430-4a2e-bcbb-7beac7422597', 'volume_name': 'volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fbbd579-0fe9-439e-bf4d-3d4f41367328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fbbd579-0fe9-439e-bf4d-3d4f41367328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dccd747-dd8b-48c6-ba10-73115894fdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:47 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Volume f40c0ba9-1430-4a2e-bcbb-7beac7422597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597', 'volume_size': 1} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-834428999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f40c0ba9-1430-4a2e-bcbb-7beac7422597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:47Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Creating volume f40c0ba9-1430-4a2e-bcbb-7beac7422597 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:47 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:47 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597 1073741824 Jul 14 21:31:47 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:47 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597 1073741824" returned: 0 in 0.521s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:47 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597 Jul 14 21:31:47 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:48 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597" returned: 0 in 0.315s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:48 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:48 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:UPDATE=298,cinder:SELECT=223,cinder:DELETE=25,cinder:INSERT=69 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:31:48 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dccd747-dd8b-48c6-ba10-73115894fdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:48 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa195f44-0685-408a-9b89-c053b990ad35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:48 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=214,cinder:UPDATE=296,cinder:INSERT=90,cinder:DELETE=27 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:31:48 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Volume volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597 (f40c0ba9-1430-4a2e-bcbb-7beac7422597): created successfully Jul 14 21:31:48 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa195f44-0685-408a-9b89-c053b990ad35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:48 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (09a00c5b-82c7-4a96-b75b-3718da4ac582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:48 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0546597b-7fd1-4a94-b3b5-8e23b3bb9a65 tempest-ProjectMemberTests-1217057865 None] Created volume successfully. Jul 14 21:31:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] Creating offline snapshot 283d825f-4867-48ff-b75e-aa017b0c576e of volume f40c0ba9-1430-4a2e-bcbb-7beac7422597 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:31:49 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64ef666-7d03-44cd-a422-f0373fa7370b]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:49 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597 Jul 14 21:31:49 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:49 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Flow 'volume_create_manager' (c33fe970-0326-4fab-9185-3eea40c83b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bf4071-ed94-4d98-b443-9ef59b568c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bf4071-ed94-4d98-b443-9ef59b568c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1198538041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a23b7ea-b453-46ec-83e7-dbd4c76e269b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5b1c77bd24e17b0068119e76d3e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:50Z,use_quota=True,user_id='bf8a2b7233c0484a9a6d98406d8185c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71a4a11-fadb-47ab-b156-6b3903762d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71a4a11-fadb-47ab-b156-6b3903762d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a52bf6f-9c48-42ef-9764-68598de594c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a52bf6f-9c48-42ef-9764-68598de594c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a23b7ea-b453-46ec-83e7-dbd4c76e269b', 'volume_name': 'volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e78bc5-5e5a-4df0-9412-0b4b441d6cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e78bc5-5e5a-4df0-9412-0b4b441d6cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:49 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5b2211-2a5b-4425-9568-e2fd4913ae84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:49 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Volume 6a23b7ea-b453-46ec-83e7-dbd4c76e269b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b', 'volume_size': 1} Jul 14 21:31:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:50 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597" returned: 0 in 0.429s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:50 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e 1G Jul 14 21:31:50 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:50 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e 1G" returned: 0 in 0.486s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:50 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e Jul 14 21:31:50 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:50 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e" returned: 0 in 0.351s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:50 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e is being set with open permissions: ugo+rw Jul 14 21:31:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:50 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e Jul 14 21:31:50 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:51 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e" returned: 0 in 0.255s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:51 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.info Jul 14 21:31:51 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:51 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.info" returned: 0 in 0.254s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:51 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.info is being set with open permissions: ugo+rw Jul 14 21:31:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:51 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.info Jul 14 21:31:51 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:51 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.info" returned: 0 in 0.260s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.808s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1198538041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a23b7ea-b453-46ec-83e7-dbd4c76e269b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5b1c77bd24e17b0068119e76d3e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:50Z,use_quota=True,user_id='bf8a2b7233c0484a9a6d98406d8185c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Creating volume 6a23b7ea-b453-46ec-83e7-dbd4c76e269b {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:51 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:51 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b 1073741824 Jul 14 21:31:51 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:51 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a8525531-acaf-4ccc-bd06-79b06f2e72af tempest-ProjectMemberTests-1217057865 None] Create snapshot completed successfully Jul 14 21:31:52 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b 1073741824" returned: 0 in 0.518s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:52 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b Jul 14 21:31:52 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:52 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b" returned: 0 in 0.285s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5b2211-2a5b-4425-9568-e2fd4913ae84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ff97fb-5850-42ae-965f-96ecfb476c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:52 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Volume volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b (6a23b7ea-b453-46ec-83e7-dbd4c76e269b): created successfully Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ff97fb-5850-42ae-965f-96ecfb476c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Flow 'volume_create_manager' (c33fe970-0326-4fab-9185-3eea40c83b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-283d825f-4867-48ff-b75e-aa017b0c576e-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:52 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0c96bef7-22f8-4957-8161-b8f7d94c91b6 tempest-ProjectReaderTests-904414844 None] Created volume successfully. Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-283d825f-4867-48ff-b75e-aa017b0c576e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-f40c0ba9-1430-4a2e-bcbb-7beac7422597" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-f40c0ba9-1430-4a2e-bcbb-7beac7422597" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-283d825f-4867-48ff-b75e-aa017b0c576e" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-283d825f-4867-48ff-b75e-aa017b0c576e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] Deleting offline snapshot 283d825f-4867-48ff-b75e-aa017b0c576e of volume f40c0ba9-1430-4a2e-bcbb-7beac7422597 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] snapshot_file for this snap is: volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50cde16-63ab-4ead-885d-5126483c7c3a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:52 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e Jul 14 21:31:52 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] Creating offline snapshot c21a14da-c774-41a1-967a-f5232d00fcd9 of volume 6a23b7ea-b453-46ec-83e7-dbd4c76e269b {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:31:53 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af6f673-408e-4259-aa31-896a6f707775]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:53 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e" returned: 0 in 0.496s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:31:53 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd54bc3-94c5-45be-a50a-e02cc684550f]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:53 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b Jul 14 21:31:53 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:53 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597 Jul 14 21:31:53 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:53 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b" returned: 0 in 0.508s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:53 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9 1G Jul 14 21:31:53 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:53 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597" returned: 0 in 0.539s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:53 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e Jul 14 21:31:53 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:54 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9 1G" returned: 0 in 0.562s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:54 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e" returned: 0 in 0.426s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:54 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9 Jul 14 21:31:54 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:54 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e Jul 14 21:31:54 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:54 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597.283d825f-4867-48ff-b75e-aa017b0c576e" returned: 0 in 0.317s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:54 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9" returned: 0 in 0.375s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:54 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9 is being set with open permissions: ugo+rw Jul 14 21:31:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-283d825f-4867-48ff-b75e-aa017b0c576e" released by "_delete_snapshot" :: held 1.921s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-f40c0ba9-1430-4a2e-bcbb-7beac7422597" released by "delete_snapshot" :: held 1.965s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:54 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9 Jul 14 21:31:54 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:54 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] Created reservations ['b8f5b2a6-8b6c-460a-9c83-0c85faa952c5', 'd1495647-4fc5-44a1-9433-826993cf1b80', 'ed4480c0-58f2-45c1-b68f-998190020860', '48a22029-2728-44fa-875e-a206f539faef'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:54 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] Delete snapshot completed successfully. Jul 14 21:31:54 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a82c9910-f8f7-47f3-8c43-97a49c815953 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-283d825f-4867-48ff-b75e-aa017b0c576e-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:54 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9" returned: 0 in 0.287s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:55 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.info Jul 14 21:31:55 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:55 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.info" returned: 0 in 0.277s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:55 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.info is being set with open permissions: ugo+rw Jul 14 21:31:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:55 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.info Jul 14 21:31:55 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:55 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.info" returned: 0 in 0.260s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.361s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:55 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-4026e794-bae9-4a2c-a016-87b58ce71482 tempest-ProjectReaderTests-904414844 None] Create snapshot completed successfully Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-f40c0ba9-1430-4a2e-bcbb-7beac7422597-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Flow 'volume_create_manager' (0a5c822c-ed33-4eb0-bb87-eaf8da3daa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8aa398-7ca5-4c2f-a387-c55aa94aa719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-f40c0ba9-1430-4a2e-bcbb-7beac7422597-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8aa398-7ca5-4c2f-a387-c55aa94aa719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1654153246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a971d8a1-94a4-40bd-b1bd-3f76d712df60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfd34ad0d21478db7c5ac6552a768eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:56Z,use_quota=True,user_id='0f006663205a4a01924175532083d79e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c387c1-267e-4c26-8dfb-5ddcb9d4a389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c387c1-267e-4c26-8dfb-5ddcb9d4a389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc7d1dde-694d-471b-a546-2d264b9a6dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc7d1dde-694d-471b-a546-2d264b9a6dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a971d8a1-94a4-40bd-b1bd-3f76d712df60', 'volume_name': 'volume-a971d8a1-94a4-40bd-b1bd-3f76d712df60', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8d3350-66c3-467f-93ea-e850bead4c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8d3350-66c3-467f-93ea-e850bead4c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d0bcea-bcd4-4a6f-a51c-be9ae2d811c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:56 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Volume a971d8a1-94a4-40bd-b1bd-3f76d712df60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a971d8a1-94a4-40bd-b1bd-3f76d712df60', 'volume_size': 1} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1654153246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a971d8a1-94a4-40bd-b1bd-3f76d712df60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfd34ad0d21478db7c5ac6552a768eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:56Z,use_quota=True,user_id='0f006663205a4a01924175532083d79e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Creating volume a971d8a1-94a4-40bd-b1bd-3f76d712df60 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:56 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a971d8a1-94a4-40bd-b1bd-3f76d712df60 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:56 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a971d8a1-94a4-40bd-b1bd-3f76d712df60 1073741824 Jul 14 21:31:56 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-f40c0ba9-1430-4a2e-bcbb-7beac7422597" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-f40c0ba9-1430-4a2e-bcbb-7beac7422597" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d98362-dae7-4ccb-959e-9e5d4e217925]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:56 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597 Jul 14 21:31:56 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-c21a14da-c774-41a1-967a-f5232d00fcd9-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] Lock "cinder-c21a14da-c774-41a1-967a-f5232d00fcd9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-quobyte-6a23b7ea-b453-46ec-83e7-dbd4c76e269b" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-6a23b7ea-b453-46ec-83e7-dbd4c76e269b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-quobyte-c21a14da-c774-41a1-967a-f5232d00fcd9" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-c21a14da-c774-41a1-967a-f5232d00fcd9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] Deleting offline snapshot c21a14da-c774-41a1-967a-f5232d00fcd9 of volume 6a23b7ea-b453-46ec-83e7-dbd4c76e269b {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:31:56 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] snapshot_file for this snap is: volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a971d8a1-94a4-40bd-b1bd-3f76d712df60 1073741824" returned: 0 in 0.566s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df98a0e-d9ae-4a8c-aed4-ed9da3c7a605]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:56 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597" returned: 0 in 0.459s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a971d8a1-94a4-40bd-b1bd-3f76d712df60 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:56 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597 Jul 14 21:31:56 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:56 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a971d8a1-94a4-40bd-b1bd-3f76d712df60 Jul 14 21:31:56 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:56 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9 Jul 14 21:31:56 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:57 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f40c0ba9-1430-4a2e-bcbb-7beac7422597" returned: 0 in 0.304s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:57 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a971d8a1-94a4-40bd-b1bd-3f76d712df60" returned: 0 in 0.288s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-f40c0ba9-1430-4a2e-bcbb-7beac7422597" released by "delete_volume" :: held 0.886s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d0bcea-bcd4-4a6f-a51c-be9ae2d811c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a971d8a1-94a4-40bd-b1bd-3f76d712df60', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfd0879-3309-4a58-a204-a3069c9578a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:57 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Volume volume-a971d8a1-94a4-40bd-b1bd-3f76d712df60 (a971d8a1-94a4-40bd-b1bd-3f76d712df60): created successfully Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfd0879-3309-4a58-a204-a3069c9578a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Flow 'volume_create_manager' (0a5c822c-ed33-4eb0-bb87-eaf8da3daa99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:57 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9" returned: 0 in 0.424s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:31:57 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-ded27810-c664-452f-bfcb-535db843e0fe tempest-ProjectReaderTests-1658570767 None] Created volume successfully. Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5758d50-8402-4e35-9bb1-41cc7bb6c739]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] Created reservations ['d425c151-8312-4cb1-b4f8-0f2b45fdeaf1', '3610302a-0fcd-4eac-b5a5-0288c0c7da00', '3e2a8356-d769-4ab6-8932-0073f35f9800', '82396ceb-08cb-4c77-b935-afe651a842fe'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:57 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b Jul 14 21:31:57 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:57 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:57 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:57 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.255s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:57 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:57 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] Deleted volume successfully. Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b" returned: 0 in 0.381s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:57 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9 Jul 14 21:31:57 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:57 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-503a0492-37d3-47f2-b8b6-a5de40f77329 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-f40c0ba9-1430-4a2e-bcbb-7beac7422597-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:58 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9" returned: 0 in 0.458s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:58 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9 Jul 14 21:31:58 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:58 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b.c21a14da-c774-41a1-967a-f5232d00fcd9" returned: 0 in 0.291s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-c21a14da-c774-41a1-967a-f5232d00fcd9" released by "_delete_snapshot" :: held 1.669s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-6a23b7ea-b453-46ec-83e7-dbd4c76e269b" released by "delete_snapshot" :: held 1.698s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] Acquiring lock "cinder-a971d8a1-94a4-40bd-b1bd-3f76d712df60-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] Lock "cinder-a971d8a1-94a4-40bd-b1bd-3f76d712df60-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:58 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] Created reservations ['3fb0056f-c940-47a2-8dc4-78d8ba228593', '5bb25bc1-ebc3-4259-8e63-8b5760378bce', '4abbb88e-9798-4a88-937b-1cde9b0788cf', 'ef23ecec-2d9b-4f8c-8939-a8c7abb25727'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] Acquiring lock "cinder-quobyte-a971d8a1-94a4-40bd-b1bd-3f76d712df60" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] Lock "cinder-quobyte-a971d8a1-94a4-40bd-b1bd-3f76d712df60" acquired by "delete_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:58 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] Delete snapshot completed successfully. Jul 14 21:31:58 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f6c1cf-a9b9-4a88-a52d-e9fc3ed52fb0]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a971d8a1-94a4-40bd-b1bd-3f76d712df60 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d2e2f4cd-bb42-406e-9f9a-4b778b8cac75 tempest-ProjectReaderTests-904414844 None] Lock "cinder-c21a14da-c774-41a1-967a-f5232d00fcd9-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:58 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a971d8a1-94a4-40bd-b1bd-3f76d712df60 Jul 14 21:31:58 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-6a23b7ea-b453-46ec-83e7-dbd4c76e269b-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] Lock "cinder-6a23b7ea-b453-46ec-83e7-dbd4c76e269b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-quobyte-6a23b7ea-b453-46ec-83e7-dbd4c76e269b" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:31:58 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-6a23b7ea-b453-46ec-83e7-dbd4c76e269b" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6a22da-e431-4cca-804b-60481491c390]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:59 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a971d8a1-94a4-40bd-b1bd-3f76d712df60" returned: 0 in 0.461s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a971d8a1-94a4-40bd-b1bd-3f76d712df60 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:59 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a971d8a1-94a4-40bd-b1bd-3f76d712df60 Jul 14 21:31:59 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:59 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b Jul 14 21:31:59 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (12a029dc-d13d-464e-a68f-ebd5ebf21a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488badff-444b-42c1-946b-af9656bfbbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488badff-444b-42c1-946b-af9656bfbbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-470827928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e16705-6260-490d-ac7f-16f514e96f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:59Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b5e7f9-fa01-467c-8192-43e63479b4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b5e7f9-fa01-467c-8192-43e63479b4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f656414f-1e49-472c-b6d1-7b75e27e1936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f656414f-1e49-472c-b6d1-7b75e27e1936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5e16705-6260-490d-ac7f-16f514e96f07', 'volume_name': 'volume-f5e16705-6260-490d-ac7f-16f514e96f07', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29bc0855-7371-48a1-accb-7e07f9afb240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29bc0855-7371-48a1-accb-7e07f9afb240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0cab03-ea00-45bb-9059-830b6eddac86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:31:59 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Volume f5e16705-6260-490d-ac7f-16f514e96f07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5e16705-6260-490d-ac7f-16f514e96f07', 'volume_size': 1} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-470827928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e16705-6260-490d-ac7f-16f514e96f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:31:59Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Creating volume f5e16705-6260-490d-ac7f-16f514e96f07 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:31:59 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:59 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07 1073741824 Jul 14 21:31:59 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:59 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-a971d8a1-94a4-40bd-b1bd-3f76d712df60" returned: 0 in 0.412s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] Lock "cinder-quobyte-a971d8a1-94a4-40bd-b1bd-3f76d712df60" released by "delete_volume" :: held 0.938s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:59 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] Created reservations ['af74b3f9-71e0-437e-906c-7eb69309e376', '744f767e-0703-4a91-bbab-f038e65af8c4', '48a9e102-2564-4fbf-99fc-e2e0b159c2ae', '8dcd107f-d0b0-4891-bcd3-b6f7798e9ae0'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b" returned: 0 in 0.530s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:59 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b Jul 14 21:31:59 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:31:59 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:31:59 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:31:59 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-6a23b7ea-b453-46ec-83e7-dbd4c76e269b" returned: 0 in 0.335s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-6a23b7ea-b453-46ec-83e7-dbd4c76e269b" released by "delete_volume" :: held 0.941s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:31:59 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.289s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:31:59 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] Deleted volume successfully. Jul 14 21:31:59 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07 1073741824" returned: 0 in 0.597s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:31:59 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-86dcc813-86db-41f5-b9fe-d38e2ec18b9d tempest-ProjectReaderTests-1658570767 None] Lock "cinder-a971d8a1-94a4-40bd-b1bd-3f76d712df60-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] Created reservations ['33683966-6c11-4838-b108-5e3456f2fd9a', '5ca1c9f9-1a7b-4139-aa7b-4e7018b596bc', '4e8c83e7-4601-4663-a9f7-25422be4e876', '38ede46f-a37f-44dd-96c6-0d0861fc2632'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:00 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07 Jul 14 21:32:00 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:00 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:32:00 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:00 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07" returned: 0 in 0.276s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0cab03-ea00-45bb-9059-830b6eddac86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5e16705-6260-490d-ac7f-16f514e96f07', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a219bc3c-5b3d-49fa-b8fb-00f039a54019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:00 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Volume volume-f5e16705-6260-490d-ac7f-16f514e96f07 (f5e16705-6260-490d-ac7f-16f514e96f07): created successfully Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a219bc3c-5b3d-49fa-b8fb-00f039a54019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (12a029dc-d13d-464e-a68f-ebd5ebf21a94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:00 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a7c331f2-57e9-4654-84f9-8c9284ab25d8 tempest-ProjectMemberTests-1217057865 None] Created volume successfully. Jul 14 21:32:00 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.279s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:32:00 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] Deleted volume successfully. Jul 14 21:32:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-744d7405-d608-46e5-9093-9f7cdfb24bd6 tempest-ProjectReaderTests-904414844 None] Lock "cinder-6a23b7ea-b453-46ec-83e7-dbd4c76e269b-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Flow 'volume_create_manager' (644817cc-07d8-4a9d-aad2-a50097c5bae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79dc2cc4-4c13-414a-a8a3-3c817f20215b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79dc2cc4-4c13-414a-a8a3-3c817f20215b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-83548688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ddd21ad-32d9-4df8-8cf3-4147727a3946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfd34ad0d21478db7c5ac6552a768eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:01Z,use_quota=True,user_id='0f006663205a4a01924175532083d79e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e01efa5-87a4-4b0a-8325-ecaf05e78d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e01efa5-87a4-4b0a-8325-ecaf05e78d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0146be64-ce56-4177-ad71-a91795cafded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0146be64-ce56-4177-ad71-a91795cafded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ddd21ad-32d9-4df8-8cf3-4147727a3946', 'volume_name': 'volume-3ddd21ad-32d9-4df8-8cf3-4147727a3946', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d68977-2dbf-43e3-8457-0b12a1365174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d68977-2dbf-43e3-8457-0b12a1365174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2533e362-30ca-485e-8c39-e0e5e76b546f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:01 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Volume 3ddd21ad-32d9-4df8-8cf3-4147727a3946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ddd21ad-32d9-4df8-8cf3-4147727a3946', 'volume_size': 1} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-83548688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ddd21ad-32d9-4df8-8cf3-4147727a3946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfd34ad0d21478db7c5ac6552a768eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:01Z,use_quota=True,user_id='0f006663205a4a01924175532083d79e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Creating volume 3ddd21ad-32d9-4df8-8cf3-4147727a3946 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:32:01 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ddd21ad-32d9-4df8-8cf3-4147727a3946 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:01 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ddd21ad-32d9-4df8-8cf3-4147727a3946 1073741824 Jul 14 21:32:01 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Flow 'volume_create_manager' (efd7b136-706c-4c5f-bdcb-a06e63e91cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fe561e-5b22-40f1-8b6e-01ea6c638888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fe561e-5b22-40f1-8b6e-01ea6c638888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034263476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d3b724-506a-49b0-901d-873bc8482eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5b1c77bd24e17b0068119e76d3e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:02Z,use_quota=True,user_id='bf8a2b7233c0484a9a6d98406d8185c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868c6b5d-4e81-43a0-a8f6-663ab0b7c245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868c6b5d-4e81-43a0-a8f6-663ab0b7c245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21858718-6e92-4945-8713-f6ff85e0a8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21858718-6e92-4945-8713-f6ff85e0a8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64d3b724-506a-49b0-901d-873bc8482eaf', 'volume_name': 'volume-64d3b724-506a-49b0-901d-873bc8482eaf', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab07fd3b-1d5e-41f3-92a2-32757dbdde08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab07fd3b-1d5e-41f3-92a2-32757dbdde08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96093395-ce4d-4f2a-9a23-04b71c02e8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:01 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Volume 64d3b724-506a-49b0-901d-873bc8482eaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64d3b724-506a-49b0-901d-873bc8482eaf', 'volume_size': 1} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:01 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ddd21ad-32d9-4df8-8cf3-4147727a3946 1073741824" returned: 0 in 0.549s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ddd21ad-32d9-4df8-8cf3-4147727a3946 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:02 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ddd21ad-32d9-4df8-8cf3-4147727a3946 Jul 14 21:32:02 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:02 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ddd21ad-32d9-4df8-8cf3-4147727a3946" returned: 0 in 0.249s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:32:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.777s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2533e362-30ca-485e-8c39-e0e5e76b546f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ddd21ad-32d9-4df8-8cf3-4147727a3946', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029bf207-9103-4f9e-bb91-764185f2e869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:02 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] Creating offline snapshot a84d1f5d-af9a-4bde-8168-921cfbe9cd3b of volume f5e16705-6260-490d-ac7f-16f514e96f07 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:32:02 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Volume volume-3ddd21ad-32d9-4df8-8cf3-4147727a3946 (3ddd21ad-32d9-4df8-8cf3-4147727a3946): created successfully Jul 14 21:32:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029bf207-9103-4f9e-bb91-764185f2e869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:02 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Flow 'volume_create_manager' (644817cc-07d8-4a9d-aad2-a50097c5bae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:02 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[852940ef-0671-4c8d-9893-b337e9d11cb7]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:02 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-c15770bd-f9a0-4b20-bc5f-686e391fc2ed tempest-ProjectReaderTests-1658570767 None] Created volume successfully. Jul 14 21:32:02 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07 Jul 14 21:32:02 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:02 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07" returned: 0 in 0.402s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:02 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b 1G Jul 14 21:32:02 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:03 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b 1G" returned: 0 in 0.446s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5e16705-6260-490d-ac7f-16f514e96f07 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:03 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5e16705-6260-490d-ac7f-16f514e96f07 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b Jul 14 21:32:03 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] Acquiring lock "cinder-3ddd21ad-32d9-4df8-8cf3-4147727a3946-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] Lock "cinder-3ddd21ad-32d9-4df8-8cf3-4147727a3946-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] Acquiring lock "cinder-quobyte-3ddd21ad-32d9-4df8-8cf3-4147727a3946" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] Lock "cinder-quobyte-3ddd21ad-32d9-4df8-8cf3-4147727a3946" acquired by "delete_volume" :: waited 0.034s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:03 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5e16705-6260-490d-ac7f-16f514e96f07 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b" returned: 0 in 0.365s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:03 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b is being set with open permissions: ugo+rw Jul 14 21:32:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:03 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fbc807-0dff-4869-9835-eb8a5c148d2b]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ddd21ad-32d9-4df8-8cf3-4147727a3946 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:03 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b Jul 14 21:32:03 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:03 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ddd21ad-32d9-4df8-8cf3-4147727a3946 Jul 14 21:32:03 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:03 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b" returned: 0 in 0.271s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:03 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.info Jul 14 21:32:03 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:04 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ddd21ad-32d9-4df8-8cf3-4147727a3946" returned: 0 in 0.468s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ddd21ad-32d9-4df8-8cf3-4147727a3946 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:04 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ddd21ad-32d9-4df8-8cf3-4147727a3946 Jul 14 21:32:04 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:04 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.info" returned: 0 in 0.380s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:04 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.info is being set with open permissions: ugo+rw Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:04 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.info Jul 14 21:32:04 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:04 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ddd21ad-32d9-4df8-8cf3-4147727a3946" returned: 0 in 0.287s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] Lock "cinder-quobyte-3ddd21ad-32d9-4df8-8cf3-4147727a3946" released by "delete_volume" :: held 0.811s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] Created reservations ['b238631b-4d20-4e63-afd6-ca0e0ef4e6e9', '0cd10905-3a0b-40fc-a4af-8284b5a4c58b', '14b6f3e3-9f99-4ca5-b76d-cf7291c9adaa', '73258a4a-81d4-4fba-8807-4def14b26442'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:04 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:32:04 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:04 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.info" returned: 0 in 0.353s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.710s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034263476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d3b724-506a-49b0-901d-873bc8482eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5b1c77bd24e17b0068119e76d3e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:02Z,use_quota=True,user_id='bf8a2b7233c0484a9a6d98406d8185c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Creating volume 64d3b724-506a-49b0-901d-873bc8482eaf {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:32:04 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:04 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf 1073741824 Jul 14 21:32:04 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:04 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-60b2eced-da0e-4a81-8def-1a1d3956bb00 tempest-ProjectMemberTests-1217057865 None] Create snapshot completed successfully Jul 14 21:32:04 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.340s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:32:04 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] Deleted volume successfully. Jul 14 21:32:04 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-130e29fe-3acc-4e29-9c8d-6fd17a7396f8 tempest-ProjectReaderTests-1658570767 None] Lock "cinder-3ddd21ad-32d9-4df8-8cf3-4147727a3946-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:05 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf 1073741824" returned: 0 in 0.601s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:05 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf Jul 14 21:32:05 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:05 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf" returned: 0 in 0.267s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96093395-ce4d-4f2a-9a23-04b71c02e8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d3b724-506a-49b0-901d-873bc8482eaf', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d77981e-b789-4dc2-8fbf-6178b385c6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:05 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Volume volume-64d3b724-506a-49b0-901d-873bc8482eaf (64d3b724-506a-49b0-901d-873bc8482eaf): created successfully Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d77981e-b789-4dc2-8fbf-6178b385c6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Flow 'volume_create_manager' (efd7b136-706c-4c5f-bdcb-a06e63e91cf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:05 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-02bc8e09-20ec-4f0e-ac45-5ce15562d25a tempest-ProjectReaderTests-904414844 None] Created volume successfully. Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-a84d1f5d-af9a-4bde-8168-921cfbe9cd3b-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-a84d1f5d-af9a-4bde-8168-921cfbe9cd3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-f5e16705-6260-490d-ac7f-16f514e96f07" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-f5e16705-6260-490d-ac7f-16f514e96f07" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-a84d1f5d-af9a-4bde-8168-921cfbe9cd3b" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-a84d1f5d-af9a-4bde-8168-921cfbe9cd3b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] Deleting offline snapshot a84d1f5d-af9a-4bde-8168-921cfbe9cd3b of volume f5e16705-6260-490d-ac7f-16f514e96f07 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] snapshot_file for this snap is: volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e772f6-b402-45d0-8279-0fc59089bd23]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:05 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:05 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b Jul 14 21:32:05 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:06 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b" returned: 0 in 0.445s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5e16705-6260-490d-ac7f-16f514e96f07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:32:06 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[8202340c-012c-4148-895b-19848fa73be8]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:06 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] Creating offline snapshot 2574335f-ca42-4398-9488-8a813705d1c5 of volume 64d3b724-506a-49b0-901d-873bc8482eaf {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:32:06 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3f0a08-7963-468f-972b-921eb59a5d92]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:06 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07 Jul 14 21:32:06 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:06 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf Jul 14 21:32:06 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:06 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07" returned: 0 in 0.536s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:06 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b Jul 14 21:32:06 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:06 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf" returned: 0 in 0.614s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:06 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:07 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5 1G Jul 14 21:32:07 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:07 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b" returned: 0 in 0.496s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:07 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b Jul 14 21:32:07 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:07 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5 1G" returned: 0 in 0.505s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64d3b724-506a-49b0-901d-873bc8482eaf -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:07 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64d3b724-506a-49b0-901d-873bc8482eaf -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5 Jul 14 21:32:07 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:07 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07.a84d1f5d-af9a-4bde-8168-921cfbe9cd3b" returned: 0 in 0.258s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-a84d1f5d-af9a-4bde-8168-921cfbe9cd3b" released by "_delete_snapshot" :: held 1.872s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-f5e16705-6260-490d-ac7f-16f514e96f07" released by "delete_snapshot" :: held 1.903s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:07 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] Created reservations ['74571141-afe0-44f8-9699-ce9782f40c80', 'd773e086-95de-4b0d-931e-08fdf2631b3b', '984697de-0b23-4e42-9883-330365a3a70b', '49895d3a-250d-4623-8e0d-e1a04eb01621'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:07 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] Delete snapshot completed successfully. Jul 14 21:32:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-6fa3fa52-0cf9-4a9f-ada8-fcdfbd5f7e77 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-a84d1f5d-af9a-4bde-8168-921cfbe9cd3b-delete_snapshot" released by "delete_snapshot" :: held 2.061s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:07 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64d3b724-506a-49b0-901d-873bc8482eaf -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5" returned: 0 in 0.351s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:07 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5 is being set with open permissions: ugo+rw Jul 14 21:32:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:07 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5 Jul 14 21:32:07 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-f5e16705-6260-490d-ac7f-16f514e96f07-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-f5e16705-6260-490d-ac7f-16f514e96f07-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:07 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-f5e16705-6260-490d-ac7f-16f514e96f07" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-f5e16705-6260-490d-ac7f-16f514e96f07" acquired by "delete_volume" :: waited 0.022s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f703192a-a1ac-4f9b-953f-06d3e3d6e893]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:08 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5" returned: 0 in 0.286s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:08 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.info Jul 14 21:32:08 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:08 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07 Jul 14 21:32:08 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:08 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.info" returned: 0 in 0.274s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:08 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.info is being set with open permissions: ugo+rw Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:08 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07" returned: 0 in 0.394s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:08 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.info Jul 14 21:32:08 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:08 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07 Jul 14 21:32:08 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:08 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.info" returned: 0 in 0.279s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:08 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-f5e16705-6260-490d-ac7f-16f514e96f07" returned: 0 in 0.284s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-f5e16705-6260-490d-ac7f-16f514e96f07" released by "delete_volume" :: held 0.755s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:08 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-254cb169-9c3c-46ed-a8ab-ef873b7d143f tempest-ProjectReaderTests-904414844 None] Create snapshot completed successfully Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] Created reservations ['bed8ab13-9ea8-4796-80d5-fe0f7f669765', '0e0e3cf7-5345-49bd-af4a-e8eec6990883', '6f8749ac-6a4e-4d8b-a8e8-9f83b2606743', '5bda236e-cfdb-44b1-bb10-523d39ca186f'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:08 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:32:08 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:09 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.260s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:32:09 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] Deleted volume successfully. Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-42e19034-b0d9-4b9a-abee-8b491014f590 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-f5e16705-6260-490d-ac7f-16f514e96f07-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-2574335f-ca42-4398-9488-8a813705d1c5-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] Lock "cinder-2574335f-ca42-4398-9488-8a813705d1c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-quobyte-64d3b724-506a-49b0-901d-873bc8482eaf" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-64d3b724-506a-49b0-901d-873bc8482eaf" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-quobyte-2574335f-ca42-4398-9488-8a813705d1c5" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-2574335f-ca42-4398-9488-8a813705d1c5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] Deleting offline snapshot 2574335f-ca42-4398-9488-8a813705d1c5 of volume 64d3b724-506a-49b0-901d-873bc8482eaf {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] snapshot_file for this snap is: volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24da89c-57ee-49d0-979c-0adaec7124d8]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (91509e2b-6d1d-419c-9cde-51f247bcb1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:09 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5 Jul 14 21:32:09 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d90889d-436f-4b20-a0a5-38da8b04e89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d90889d-436f-4b20-a0a5-38da8b04e89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1253097969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d84e855-32f7-40b7-af49-d850a828a2d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:10Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b874a20b-315b-44a4-a235-677b46ce309b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b874a20b-315b-44a4-a235-677b46ce309b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d077b1e2-3c9e-4779-bbaa-68afc22e7783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d077b1e2-3c9e-4779-bbaa-68afc22e7783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d84e855-32f7-40b7-af49-d850a828a2d8', 'volume_name': 'volume-9d84e855-32f7-40b7-af49-d850a828a2d8', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103f73eb-ea85-45da-9830-cc040a90c05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103f73eb-ea85-45da-9830-cc040a90c05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5763bb7b-3097-4210-be64-d11dd77bda31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:09 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Volume 9d84e855-32f7-40b7-af49-d850a828a2d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d84e855-32f7-40b7-af49-d850a828a2d8', 'volume_size': 1} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1253097969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d84e855-32f7-40b7-af49-d850a828a2d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:10Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Creating volume 9d84e855-32f7-40b7-af49-d850a828a2d8 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:32:09 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:09 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8 1073741824 Jul 14 21:32:09 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:09 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5" returned: 0 in 0.394s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64d3b724-506a-49b0-901d-873bc8482eaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:32:10 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb30225-b6bd-4d5f-891c-22d3eb497f22]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:10 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf Jul 14 21:32:10 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:10 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8 1073741824" returned: 0 in 0.486s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:10 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8 Jul 14 21:32:10 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:10 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf" returned: 0 in 0.435s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:10 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5 Jul 14 21:32:10 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:10 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8" returned: 0 in 0.386s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:32:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5763bb7b-3097-4210-be64-d11dd77bda31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d84e855-32f7-40b7-af49-d850a828a2d8', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cc50fd-0bce-4601-bae7-c9efbc0260ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:10 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Volume volume-9d84e855-32f7-40b7-af49-d850a828a2d8 (9d84e855-32f7-40b7-af49-d850a828a2d8): created successfully Jul 14 21:32:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cc50fd-0bce-4601-bae7-c9efbc0260ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (91509e2b-6d1d-419c-9cde-51f247bcb1b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:10 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-58f0644b-ba13-4fc6-99ac-444288b96645 tempest-ProjectMemberTests-1217057865 None] Created volume successfully. Jul 14 21:32:10 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5" returned: 0 in 0.472s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:10 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5 Jul 14 21:32:10 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:11 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf.2574335f-ca42-4398-9488-8a813705d1c5" returned: 0 in 0.250s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-2574335f-ca42-4398-9488-8a813705d1c5" released by "_delete_snapshot" :: held 1.660s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-64d3b724-506a-49b0-901d-873bc8482eaf" released by "delete_snapshot" :: held 1.684s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:11 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] Created reservations ['c1f7aa1d-9b6d-4c3b-9f84-172b677b7d58', 'fe4491ff-1912-422d-bbc1-2e17be3ece1e', 'a768fe08-d1a2-4ae0-b5d1-0173f78406d7', '29f931c9-5745-42c5-85e4-90bd11289a0b'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:11 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] Delete snapshot completed successfully. Jul 14 21:32:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7e7e7c2c-fb01-4de7-9267-e289cfac8920 tempest-ProjectReaderTests-904414844 None] Lock "cinder-2574335f-ca42-4398-9488-8a813705d1c5-delete_snapshot" released by "delete_snapshot" :: held 1.846s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-64d3b724-506a-49b0-901d-873bc8482eaf-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] Lock "cinder-64d3b724-506a-49b0-901d-873bc8482eaf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-quobyte-64d3b724-506a-49b0-901d-873bc8482eaf" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-64d3b724-506a-49b0-901d-873bc8482eaf" acquired by "delete_volume" :: waited 0.020s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:11 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb88411-30fc-4e44-bf25-934174898497]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] Creating offline snapshot d83ecb40-c37c-4c6c-aee6-8578031dd1ec of volume 9d84e855-32f7-40b7-af49-d850a828a2d8 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:32:12 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f92b2b-5db0-4125-bb26-83ed1c1c6b44]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:12 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf Jul 14 21:32:12 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:12 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8 Jul 14 21:32:12 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:12 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf" returned: 0 in 0.472s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:12 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf Jul 14 21:32:12 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:12 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8" returned: 0 in 0.536s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:12 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec 1G Jul 14 21:32:12 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:12 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-64d3b724-506a-49b0-901d-873bc8482eaf" returned: 0 in 0.347s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-64d3b724-506a-49b0-901d-873bc8482eaf" released by "delete_volume" :: held 0.930s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:12 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] Created reservations ['0051e1b9-4456-41d1-96a1-ed28440a5dcf', '356a763f-ee94-484c-b4e7-2cf3db40de8d', '6831feae-047e-46cb-8bf7-73e8a6bc1407', 'bb07be58-9722-401f-8e99-c4f5fed70d42'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:13 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:32:13 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:13 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec 1G" returned: 0 in 0.561s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d84e855-32f7-40b7-af49-d850a828a2d8 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:13 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d84e855-32f7-40b7-af49-d850a828a2d8 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec Jul 14 21:32:13 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:13 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.293s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:13 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:32:13 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] Deleted volume successfully. Jul 14 21:32:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-0cfdc47a-85ff-4edb-93f4-ad3f990aa942 tempest-ProjectReaderTests-904414844 None] Lock "cinder-64d3b724-506a-49b0-901d-873bc8482eaf-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:13 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d84e855-32f7-40b7-af49-d850a828a2d8 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec" returned: 0 in 0.311s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:13 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec is being set with open permissions: ugo+rw Jul 14 21:32:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:13 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec Jul 14 21:32:13 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:13 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec" returned: 0 in 0.264s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:13 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.info Jul 14 21:32:13 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:14 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.info" returned: 0 in 0.312s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:14 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.info is being set with open permissions: ugo+rw Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:14 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.info Jul 14 21:32:14 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:14 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.info" returned: 0 in 0.348s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.442s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:14 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-79d070d4-cec7-4a88-a410-1a434b7f759f tempest-ProjectMemberTests-1217057865 None] Create snapshot completed successfully Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Flow 'volume_create_manager' (c969a64b-c215-4a34-9f14-f5517414741b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6947f8e-f143-4979-bf82-345d7e5b326c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6947f8e-f143-4979-bf82-345d7e5b326c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-166511606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7851d8c8-2062-448f-a8d9-da1b99a9070e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5b1c77bd24e17b0068119e76d3e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:15Z,use_quota=True,user_id='bf8a2b7233c0484a9a6d98406d8185c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7d1b81-4564-4f6c-bcdc-7e2dd99bb75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7d1b81-4564-4f6c-bcdc-7e2dd99bb75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba09af6-e94c-4036-8dbb-6f652db7f0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba09af6-e94c-4036-8dbb-6f652db7f0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7851d8c8-2062-448f-a8d9-da1b99a9070e', 'volume_name': 'volume-7851d8c8-2062-448f-a8d9-da1b99a9070e', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8f1699-647b-4628-9fd5-5c119223cbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8f1699-647b-4628-9fd5-5c119223cbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755a6632-f8d9-4bde-abdf-f410469c9bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:14 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Volume 7851d8c8-2062-448f-a8d9-da1b99a9070e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7851d8c8-2062-448f-a8d9-da1b99a9070e', 'volume_size': 1} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-166511606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7851d8c8-2062-448f-a8d9-da1b99a9070e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5b1c77bd24e17b0068119e76d3e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:15Z,use_quota=True,user_id='bf8a2b7233c0484a9a6d98406d8185c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Creating volume 7851d8c8-2062-448f-a8d9-da1b99a9070e {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:32:14 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:32:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:14 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e 1073741824 Jul 14 21:32:14 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-d83ecb40-c37c-4c6c-aee6-8578031dd1ec-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-d83ecb40-c37c-4c6c-aee6-8578031dd1ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-9d84e855-32f7-40b7-af49-d850a828a2d8" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-9d84e855-32f7-40b7-af49-d850a828a2d8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-d83ecb40-c37c-4c6c-aee6-8578031dd1ec" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-d83ecb40-c37c-4c6c-aee6-8578031dd1ec" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] Deleting offline snapshot d83ecb40-c37c-4c6c-aee6-8578031dd1ec of volume 9d84e855-32f7-40b7-af49-d850a828a2d8 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] snapshot_file for this snap is: volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65a1b3d-6fb7-41b2-afc6-b5be4f7f9ed5]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:15 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e 1073741824" returned: 0 in 0.556s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Flow 'volume_create_manager' (4f530c76-2cf3-42de-9813-f75b4ac3b92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477f4ceb-d705-423c-93bc-ee3081dcec75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477f4ceb-d705-423c-93bc-ee3081dcec75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-795983133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8696c0bc-89b8-4da1-8b0c-fc31d279629d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d473663dda42129a3d440ec7dca6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:15Z,use_quota=True,user_id='0aa67068edb74640ade67cfd11b8e1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:15 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec Jul 14 21:32:15 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9bad668-7ef5-4b58-8038-f540aaa07bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9bad668-7ef5-4b58-8038-f540aaa07bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c86ee6f-c5df-4264-9642-88f60b8593cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c86ee6f-c5df-4264-9642-88f60b8593cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8696c0bc-89b8-4da1-8b0c-fc31d279629d', 'volume_name': 'volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b854bd42-dc7c-4e59-8406-41f759d00fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b854bd42-dc7c-4e59-8406-41f759d00fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1878428-22f6-4663-83d3-a1e6fa3b9057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:15 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Volume 8696c0bc-89b8-4da1-8b0c-fc31d279629d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d', 'volume_size': 1} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:15 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e Jul 14 21:32:15 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:15 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec" returned: 0 in 0.391s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d84e855-32f7-40b7-af49-d850a828a2d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:32:15 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e" returned: 0 in 0.261s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9338562d-7a84-4c8c-84c9-df7166d56770]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.269s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-795983133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8696c0bc-89b8-4da1-8b0c-fc31d279629d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d473663dda42129a3d440ec7dca6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:15Z,use_quota=True,user_id='0aa67068edb74640ade67cfd11b8e1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Creating volume 8696c0bc-89b8-4da1-8b0c-fc31d279629d {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:32:15 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:15 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d 1073741824 Jul 14 21:32:15 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755a6632-f8d9-4bde-abdf-f410469c9bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7851d8c8-2062-448f-a8d9-da1b99a9070e', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80712f0-2b04-411b-b648-6789463a7fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:15 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Volume volume-7851d8c8-2062-448f-a8d9-da1b99a9070e (7851d8c8-2062-448f-a8d9-da1b99a9070e): created successfully Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80712f0-2b04-411b-b648-6789463a7fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Flow 'volume_create_manager' (c969a64b-c215-4a34-9f14-f5517414741b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:15 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0a861b5b-871d-45fd-ac3f-c04dd29ac263 tempest-ProjectReaderTests-904414844 None] Created volume successfully. Jul 14 21:32:15 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8 Jul 14 21:32:15 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:16 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8" returned: 0 in 0.368s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:16 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec Jul 14 21:32:16 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:16 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d 1073741824" returned: 0 in 0.422s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:16 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d Jul 14 21:32:16 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:16 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec" returned: 0 in 0.335s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:16 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d" returned: 0 in 0.271s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:16 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec Jul 14 21:32:16 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1878428-22f6-4663-83d3-a1e6fa3b9057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78777977-e0f5-47f4-903f-68bdadd18340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:16 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Volume volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d (8696c0bc-89b8-4da1-8b0c-fc31d279629d): created successfully Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78777977-e0f5-47f4-903f-68bdadd18340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Flow 'volume_create_manager' (4f530c76-2cf3-42de-9813-f75b4ac3b92c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:16 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-3ad3a4bc-1f68-4510-94f9-042eca9d0c66 tempest-SnapshotDependencyTests-2013011214 None] Created volume successfully. Jul 14 21:32:16 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8.d83ecb40-c37c-4c6c-aee6-8578031dd1ec" returned: 0 in 0.259s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-d83ecb40-c37c-4c6c-aee6-8578031dd1ec" released by "_delete_snapshot" :: held 1.470s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-9d84e855-32f7-40b7-af49-d850a828a2d8" released by "delete_snapshot" :: held 1.493s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] Created reservations ['355c2d09-88c6-44f1-acee-d7d5a7f1fcce', '5a7515a1-9a73-4152-8c8e-f4bbf89febae', '09ae5105-5bad-4d35-b4d3-6a0f9f231df5', '409bd449-282c-47b9-a5fd-f50a3b591959'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:16 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] Delete snapshot completed successfully. Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-7887afd1-c743-432d-a385-519eb6eae177 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-d83ecb40-c37c-4c6c-aee6-8578031dd1ec-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] Creating offline snapshot 54a3d811-f3c5-4f22-b49c-1132545ab46c of volume 7851d8c8-2062-448f-a8d9-da1b99a9070e {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75b003e-a648-4410-afc6-80b2bbf33027]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:17 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e Jul 14 21:32:17 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:17 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e" returned: 0 in 0.350s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:17 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c 1G Jul 14 21:32:17 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-9d84e855-32f7-40b7-af49-d850a828a2d8-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-9d84e855-32f7-40b7-af49-d850a828a2d8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-9d84e855-32f7-40b7-af49-d850a828a2d8" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-9d84e855-32f7-40b7-af49-d850a828a2d8" acquired by "delete_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:17 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[4457068a-b9a2-43e5-92a7-33b45edcce86]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:17 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8 Jul 14 21:32:17 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:17 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c 1G" returned: 0 in 0.499s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7851d8c8-2062-448f-a8d9-da1b99a9070e -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:17 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7851d8c8-2062-448f-a8d9-da1b99a9070e -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c Jul 14 21:32:17 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:17 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8" returned: 0 in 0.405s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:17 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8 Jul 14 21:32:17 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:18 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7851d8c8-2062-448f-a8d9-da1b99a9070e -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c" returned: 0 in 0.290s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:18 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c is being set with open permissions: ugo+rw Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:18 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c Jul 14 21:32:18 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:18 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-9d84e855-32f7-40b7-af49-d850a828a2d8" returned: 0 in 0.252s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-9d84e855-32f7-40b7-af49-d850a828a2d8" released by "delete_volume" :: held 0.719s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] Created reservations ['e40e5c30-5da6-475a-86d7-e849ad9c1367', '1eac1c12-6cf2-496b-a214-624c1f2e098a', 'dbf9a41f-722a-4a75-90ba-b894ac996d4d', '90332e0d-0f33-420a-b725-5cdb73a9db0e'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:18 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:32:18 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:18 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c" returned: 0 in 0.248s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:18 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.info Jul 14 21:32:18 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:18 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.253s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:32:18 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] Deleted volume successfully. Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-d01d0915-67d7-4e01-ace2-716092e3e205 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-9d84e855-32f7-40b7-af49-d850a828a2d8-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:18 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.info" returned: 0 in 0.258s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:18 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.info is being set with open permissions: ugo+rw Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:18 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.info Jul 14 21:32:18 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:18 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.info" returned: 0 in 0.267s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.204s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] Creating offline snapshot 42e6c48f-00ec-44c8-8e9c-ab3f839fe58b of volume 8696c0bc-89b8-4da1-8b0c-fc31d279629d {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:32:18 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2c95a29d-a6c6-4ccc-88b5-ee013b0ef7b4 tempest-ProjectReaderTests-904414844 None] Create snapshot completed successfully Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c90000d-778a-4af5-a1ac-b96e7bf670db]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:18 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (ee77be4e-9484-4962-8bec-baba87454734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9589203a-f6f5-4629-8f35-6e1b7c2e28e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9589203a-f6f5-4629-8f35-6e1b7c2e28e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878954640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:19Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad47fd4-cd1e-4ead-9d86-1f817c356b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad47fd4-cd1e-4ead-9d86-1f817c356b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46dafd54-909f-44bb-ab94-57de9b1bed8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46dafd54-909f-44bb-ab94-57de9b1bed8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d', 'volume_name': 'volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:19 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d Jul 14 21:32:19 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfe6f50-18f0-4362-a345-3aa52aacbcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfe6f50-18f0-4362-a345-3aa52aacbcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a5ef87-87bf-402a-b319-10b90be99876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:19 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Volume 3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d', 'volume_size': 1} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-54a3d811-f3c5-4f22-b49c-1132545ab46c-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] Lock "cinder-54a3d811-f3c5-4f22-b49c-1132545ab46c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-quobyte-7851d8c8-2062-448f-a8d9-da1b99a9070e" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-7851d8c8-2062-448f-a8d9-da1b99a9070e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-quobyte-54a3d811-f3c5-4f22-b49c-1132545ab46c" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-54a3d811-f3c5-4f22-b49c-1132545ab46c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] Deleting offline snapshot 54a3d811-f3c5-4f22-b49c-1132545ab46c of volume 7851d8c8-2062-448f-a8d9-da1b99a9070e {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] snapshot_file for this snap is: volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[27694a70-da20-4e0f-9b87-08c2573667f5]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:19 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c Jul 14 21:32:19 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:19 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d" returned: 0 in 0.386s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:19 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b 1G Jul 14 21:32:19 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:19 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c" returned: 0 in 0.361s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7851d8c8-2062-448f-a8d9-da1b99a9070e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e1131c-890a-4e18-bfec-42acc67c42a4]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:19 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e Jul 14 21:32:19 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:19 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b 1G" returned: 0 in 0.423s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:19 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b Jul 14 21:32:19 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:19 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e" returned: 0 in 0.379s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:19 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:20 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c Jul 14 21:32:20 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:20 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b" returned: 0 in 0.279s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:20 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b is being set with open permissions: ugo+rw Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:20 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b Jul 14 21:32:20 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:20 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b" returned: 0 in 0.242s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:20 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c" returned: 0 in 0.346s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:20 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c Jul 14 21:32:20 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:20 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.info Jul 14 21:32:20 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:20 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e.54a3d811-f3c5-4f22-b49c-1132545ab46c" returned: 0 in 0.240s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-54a3d811-f3c5-4f22-b49c-1132545ab46c" released by "_delete_snapshot" :: held 1.430s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:20 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-7851d8c8-2062-448f-a8d9-da1b99a9070e" released by "delete_snapshot" :: held 1.453s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.info" returned: 0 in 0.251s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:20 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.info is being set with open permissions: ugo+rw Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:20 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.info Jul 14 21:32:20 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] Created reservations ['fa1e4d57-47cf-4b15-8f53-169a64a3b720', '0e1b92f6-a39b-4534-a68d-f6eb35da78c3', '1bc7c121-3b9a-4a7b-a5d9-d0c222508eff', '7b174743-bcf5-4fa3-8fe2-2817235aeda0'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:20 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] Delete snapshot completed successfully. Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-5adbc013-9d6f-457d-a92f-f8967c106ea3 tempest-ProjectReaderTests-904414844 None] Lock "cinder-54a3d811-f3c5-4f22-b49c-1132545ab46c-delete_snapshot" released by "delete_snapshot" :: held 1.603s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:20 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.info" returned: 0 in 0.245s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.755s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878954640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:19Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Creating volume 3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:32:20 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:32:20 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:20 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d 1073741824 Jul 14 21:32:20 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:20 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a7956940-5ae3-4ab8-ab11-e1591b941d97 tempest-SnapshotDependencyTests-2013011214 None] Create snapshot completed successfully Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-7851d8c8-2062-448f-a8d9-da1b99a9070e-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] Lock "cinder-7851d8c8-2062-448f-a8d9-da1b99a9070e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-quobyte-7851d8c8-2062-448f-a8d9-da1b99a9070e" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:21 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d 1073741824" returned: 0 in 0.438s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-7851d8c8-2062-448f-a8d9-da1b99a9070e" acquired by "delete_volume" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8ee044-e596-47a4-b068-4e4242db0d23]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:21 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d Jul 14 21:32:21 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:21 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e Jul 14 21:32:21 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:21 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d" returned: 0 in 0.249s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a5ef87-87bf-402a-b319-10b90be99876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73e9f38-5b17-487c-a8ae-4bebd5e997d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:21 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Volume volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d (3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d): created successfully Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73e9f38-5b17-487c-a8ae-4bebd5e997d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (ee77be4e-9484-4962-8bec-baba87454734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:21 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-825122ab-d49d-43dc-98b5-73a58c9f77ed tempest-ProjectMemberTests-1217057865 None] Created volume successfully. Jul 14 21:32:21 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e" returned: 0 in 0.378s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:21 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e Jul 14 21:32:21 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:21 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:21 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-7851d8c8-2062-448f-a8d9-da1b99a9070e" returned: 0 in 0.249s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-7851d8c8-2062-448f-a8d9-da1b99a9070e" released by "delete_volume" :: held 0.688s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] Created reservations ['91d15aa8-1e7a-4e96-83c3-707690bd6caa', 'e87a13d6-6a60-4a4a-92b1-b2abdad4ee85', 'b249d110-ed68-477a-b639-1ce151a138cd', '5a3d2794-244f-48e2-b2cb-0256f552f55f'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:22 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:32:22 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:22 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.297s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:32:22 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] Deleted volume successfully. Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-1681ec7e-ac30-45b4-94ad-b884d3f6bfee tempest-ProjectReaderTests-904414844 None] Lock "cinder-7851d8c8-2062-448f-a8d9-da1b99a9070e-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] Creating offline snapshot 3ac52164-f4a9-4f35-aaad-a11042c88fad of volume 3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Flow 'volume_create_manager' (a94dd46d-5789-4a61-a4fb-dc6e5ec430d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2f9ede-b9ca-4298-823b-7cf2df78b6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f967e71-8f06-47b9-9833-7c9dc3395984]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d2f9ede-b9ca-4298-823b-7cf2df78b6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ba4fb2-52a4-44c4-bf1c-7223bc04f866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d473663dda42129a3d440ec7dca6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=42e6c48f-00ec-44c8-8e9c-ab3f839fe58b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:22Z,use_quota=True,user_id='0aa67068edb74640ade67cfd11b8e1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b803544f-66e0-4934-83bb-45fe3c9895fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b803544f-66e0-4934-83bb-45fe3c9895fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9172e3a-d89f-477d-9f48-6a06808377c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9172e3a-d89f-477d-9f48-6a06808377c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '71ba4fb2-52a4-44c4-bf1c-7223bc04f866', 'volume_name': 'volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866', 'volume_size': 1, 'snapshot_id': '42e6c48f-00ec-44c8-8e9c-ab3f839fe58b'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f20135-5586-405a-a41e-7b18155036f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f20135-5586-405a-a41e-7b18155036f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b898e9c-0429-4343-9f38-d07c8c552aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:22 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Volume 71ba4fb2-52a4-44c4-bf1c-7223bc04f866: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866', 'volume_size': 1, 'snapshot_id': '42e6c48f-00ec-44c8-8e9c-ab3f839fe58b'} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:22 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d Jul 14 21:32:22 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Flow 'volume_create_manager' (9d109ba6-bd6e-4ea3-a396-aa95bba71696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6092981-7c20-40ea-b105-7ead33019497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6092981-7c20-40ea-b105-7ead33019497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1369917476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930ad2f1-d898-425a-89e9-478b1fa3cdf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5b1c77bd24e17b0068119e76d3e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:23Z,use_quota=True,user_id='bf8a2b7233c0484a9a6d98406d8185c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a3f0a4-2e08-437b-8ce9-aa666c40caea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a3f0a4-2e08-437b-8ce9-aa666c40caea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ccd497-f5ae-4154-98f8-56a6952aaf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ccd497-f5ae-4154-98f8-56a6952aaf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '930ad2f1-d898-425a-89e9-478b1fa3cdf7', 'volume_name': 'volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e56df0b-7ab9-4110-bdad-7701ad29d5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e56df0b-7ab9-4110-bdad-7701ad29d5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc023924-d561-402c-9a3a-9e6af49240d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:22 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Volume 930ad2f1-d898-425a-89e9-478b1fa3cdf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7', 'volume_size': 1} Jul 14 21:32:22 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:23 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d" returned: 0 in 0.386s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:23 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad 1G Jul 14 21:32:23 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:23 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad 1G" returned: 0 in 0.391s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:23 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad Jul 14 21:32:23 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:23 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad" returned: 0 in 0.286s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:23 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad is being set with open permissions: ugo+rw Jul 14 21:32:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:23 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad Jul 14 21:32:23 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:23 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad" returned: 0 in 0.234s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:23 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:23 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.info Jul 14 21:32:23 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:24 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.info" returned: 0 in 0.248s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:24 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.info is being set with open permissions: ugo+rw Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:24 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.info Jul 14 21:32:24 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:24 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.info" returned: 0 in 0.240s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.923s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.754s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Acquiring lock "cinder-quobyte-42e6c48f-00ec-44c8-8e9c-ab3f839fe58b-71ba4fb2-52a4-44c4-bf1c-7223bc04f866" by "_create_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-quobyte-42e6c48f-00ec-44c8-8e9c-ab3f839fe58b-71ba4fb2-52a4-44c4-bf1c-7223bc04f866" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Creating volume 71ba4fb2-52a4-44c4-bf1c-7223bc04f866 from snapshot 42e6c48f-00ec-44c8-8e9c-ab3f839fe58b {{(pid=88300) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Acquiring lock "cinder-quobyte-71ba4fb2-52a4-44c4-bf1c-7223bc04f866" by "_copy_volume_from_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:24 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-6edc05fe-f67e-4cfc-bd51-bed18f74d25c tempest-ProjectMemberTests-1217057865 None] Create snapshot completed successfully Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-quobyte-71ba4fb2-52a4-44c4-bf1c-7223bc04f866" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] snapshot: 42e6c48f-00ec-44c8-8e9c-ab3f839fe58b, volume: 71ba4fb2-52a4-44c4-bf1c-7223bc04f866, {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a2daaf-f05e-4aa8-87d6-3046cfd242e1]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:24 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b Jul 14 21:32:24 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:24 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b" returned: 0 in 0.392s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Creating direct copy from snapshot {{(pid=88300) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[158a809c-9ec3-4eda-a3fe-fe7d75a1844b]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:24 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:25 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d Jul 14 21:32:25 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:25 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d" returned: 0 in 0.350s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:25 devstack cinder-volume[88300]: DEBUG cinder.utils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Path /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866 not found in is_blk_device check {{(pid=88300) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 14 21:32:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:25 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866 Jul 14 21:32:25 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-3ac52164-f4a9-4f35-aaad-a11042c88fad-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] Lock "cinder-3ac52164-f4a9-4f35-aaad-a11042c88fad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-3ac52164-f4a9-4f35-aaad-a11042c88fad" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:25 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-3ac52164-f4a9-4f35-aaad-a11042c88fad" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] Deleting offline snapshot 3ac52164-f4a9-4f35-aaad-a11042c88fad of volume 3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:32:25 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] snapshot_file for this snap is: volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:32:25 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b87f6a5-14ae-47e7-bda3-39fbbadc6154]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:25 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:25 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad Jul 14 21:32:25 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:26 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad" returned: 0 in 0.540s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:26 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:32:26 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[6269854b-2af6-450d-8bc6-f3ae7bd9e830]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:26 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d Jul 14 21:32:26 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:26 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d" returned: 0 in 0.654s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:26 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:26 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad Jul 14 21:32:26 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:27 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad" returned: 0 in 0.769s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:27 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:27 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad Jul 14 21:32:27 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:28 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:28 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d.3ac52164-f4a9-4f35-aaad-a11042c88fad" returned: 0 in 0.396s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:28 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-3ac52164-f4a9-4f35-aaad-a11042c88fad" released by "_delete_snapshot" :: held 2.523s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:28 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d" released by "delete_snapshot" :: held 2.549s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:28 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] Created reservations ['adad5970-6ae7-4145-83c1-367e05a03629', 'a9fc4630-72ef-405e-8039-7ce84ede9ba5', '5467b980-65fa-4bd7-bc55-9cc098177f03', '5848fcb9-373d-4b8f-b8b3-6fe34f7c0d9b'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:28 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] Delete snapshot completed successfully. Jul 14 21:32:28 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-a7da9291-433c-4cbe-866a-669f656631bc tempest-ProjectMemberTests-1217057865 None] Lock "cinder-3ac52164-f4a9-4f35-aaad-a11042c88fad-delete_snapshot" released by "delete_snapshot" :: held 2.876s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:28 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] Lock "cinder-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:29 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d" acquired by "delete_volume" :: waited 0.033s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:29 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8c322d-efc3-4265-a12b-5c54e7818eec]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:29 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d Jul 14 21:32:29 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:29 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866" returned: 0 in 4.594s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:29 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9484a666-76ef-444b-960d-0a94ce1e716a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:29 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:30 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d" returned: 0 in 0.815s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:30 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d Jul 14 21:32:30 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:30 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d Jul 14 21:32:30 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:30 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d" returned: 0 in 0.255s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d" released by "delete_volume" :: held 1.168s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] Created reservations ['87621914-9b58-4445-bb65-9d3d61be5c77', 'f050af2b-3900-407b-9ddf-27d1e973f46d', 'e3abc4d5-3421-49a5-ad61-c4a4d0b00598', 'a1660af9-58bd-4ef9-a27d-a1bc8651d2f0'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:30 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:32:30 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:30 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d" returned: 0 in 0.548s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.image.image_utils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Image conversion details: src /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d, size 1024.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866 {{(pid=88300) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 14 21:32:30 devstack cinder-volume[88300]: INFO cinder.image.image_utils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Converted 1024.00 MB image at 222.82 MB/s Jul 14 21:32:30 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866 is being set with open permissions: ugo+rw Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:30 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866 Jul 14 21:32:30 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:30 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.246s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:32:30 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] Deleted volume successfully. Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-14935e6a-8367-452c-9130-eac67ba2792e tempest-ProjectMemberTests-1217057865 None] Lock "cinder-3ac6253a-9b5e-4fe9-9b0e-6fa3f80a1f0d-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:30 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866" returned: 0 in 0.280s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-quobyte-71ba4fb2-52a4-44c4-bf1c-7223bc04f866" released by "_copy_volume_from_snapshot" :: held 6.252s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-quobyte-42e6c48f-00ec-44c8-8e9c-ab3f839fe58b-71ba4fb2-52a4-44c4-bf1c-7223bc04f866" released by "_create_volume_from_snapshot" :: held 6.282s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.314s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.797s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1369917476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930ad2f1-d898-425a-89e9-478b1fa3cdf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5b1c77bd24e17b0068119e76d3e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:23Z,use_quota=True,user_id='bf8a2b7233c0484a9a6d98406d8185c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Creating volume 930ad2f1-d898-425a-89e9-478b1fa3cdf7 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:32:30 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:30 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7 1073741824 Jul 14 21:32:30 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b898e9c-0429-4343-9f38-d07c8c552aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866', 'volume_size': 1, 'snapshot_id': '42e6c48f-00ec-44c8-8e9c-ab3f839fe58b'}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c000db-647b-41da-b8ef-0d4ba34a6133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:30 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Volume volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866 (71ba4fb2-52a4-44c4-bf1c-7223bc04f866): created successfully Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c000db-647b-41da-b8ef-0d4ba34a6133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:30 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Flow 'volume_create_manager' (a94dd46d-5789-4a61-a4fb-dc6e5ec430d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:30 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-cf161fec-a8e2-4440-b806-0238a58d9d50 tempest-SnapshotDependencyTests-2013011214 None] Created volume successfully. Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] Acquiring lock "cinder-42e6c48f-00ec-44c8-8e9c-ab3f839fe58b-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-42e6c48f-00ec-44c8-8e9c-ab3f839fe58b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] Acquiring lock "cinder-quobyte-8696c0bc-89b8-4da1-8b0c-fc31d279629d" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-quobyte-8696c0bc-89b8-4da1-8b0c-fc31d279629d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] Acquiring lock "cinder-quobyte-42e6c48f-00ec-44c8-8e9c-ab3f839fe58b" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-quobyte-42e6c48f-00ec-44c8-8e9c-ab3f839fe58b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] Deleting offline snapshot 42e6c48f-00ec-44c8-8e9c-ab3f839fe58b of volume 8696c0bc-89b8-4da1-8b0c-fc31d279629d {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] snapshot_file for this snap is: volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db1d2e2-72de-4c47-8ec9-5e88d13f5547]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:31 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7 1073741824" returned: 0 in 0.452s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:31 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7 Jul 14 21:32:31 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:31 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b Jul 14 21:32:31 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:31 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7" returned: 0 in 0.277s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc023924-d561-402c-9a3a-9e6af49240d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd811238-5bf6-4883-b489-86bcf0f8d327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:31 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Volume volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7 (930ad2f1-d898-425a-89e9-478b1fa3cdf7): created successfully Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd811238-5bf6-4883-b489-86bcf0f8d327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Flow 'volume_create_manager' (9d109ba6-bd6e-4ea3-a396-aa95bba71696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:31 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-7f9f693c-dcc8-4d69-8781-822978b6451a tempest-ProjectReaderTests-904414844 None] Created volume successfully. Jul 14 21:32:31 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b" returned: 0 in 0.451s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e83de9-d7b3-4e9e-8885-9c14b96dbed5]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (cc46a663-4313-47c8-ac10-2ea0ec4cee69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81701e25-2a6f-4d70-865c-d1fb71fe9270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81701e25-2a6f-4d70-865c-d1fb71fe9270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-155427412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:32Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe3adec-5c27-45a6-9947-22fb5c40f146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe3adec-5c27-45a6-9947-22fb5c40f146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cda1981-95f6-4902-9d8e-f0e93feedcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cda1981-95f6-4902-9d8e-f0e93feedcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2', 'volume_name': 'volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fd50a5-792b-4b0e-93bc-12ea27aa96e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:31 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d Jul 14 21:32:31 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fd50a5-792b-4b0e-93bc-12ea27aa96e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52e192c-9397-4c7c-a592-894762800013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:31 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Volume 8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2', 'volume_size': 1} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-155427412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:32Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Creating volume 8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:32:31 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:31 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 1073741824 Jul 14 21:32:31 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:31 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:32 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d" returned: 0 in 0.415s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:32 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b Jul 14 21:32:32 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:32 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 1073741824" returned: 0 in 0.443s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:32 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 Jul 14 21:32:32 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:32 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b" returned: 0 in 0.333s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:32 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b Jul 14 21:32:32 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:32 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2" returned: 0 in 0.253s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.622s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52e192c-9397-4c7c-a592-894762800013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd15674d-dfac-4a9a-8a5d-3b45064a1fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] Creating offline snapshot 354c58ba-37a6-4807-ba12-7012fe1b93ce of volume 930ad2f1-d898-425a-89e9-478b1fa3cdf7 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:32:32 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Volume volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 (8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2): created successfully Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd15674d-dfac-4a9a-8a5d-3b45064a1fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (cc46a663-4313-47c8-ac10-2ea0ec4cee69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9415be70-a797-4319-9680-8fa3f3d57da0]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:32 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d1c6e5a6-65d8-4b26-a5d2-f8bc71c708d0 tempest-ProjectMemberTests-1217057865 None] Created volume successfully. Jul 14 21:32:32 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d.42e6c48f-00ec-44c8-8e9c-ab3f839fe58b" returned: 0 in 0.257s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-quobyte-42e6c48f-00ec-44c8-8e9c-ab3f839fe58b" released by "_delete_snapshot" :: held 1.576s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-quobyte-8696c0bc-89b8-4da1-8b0c-fc31d279629d" released by "delete_snapshot" :: held 1.597s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:32 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7 Jul 14 21:32:32 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] Created reservations ['d3dfd60a-8d54-43a6-9d43-ced62bf1d2c1', 'bcdefb7f-8f7b-4022-841e-257ebd9f4034', 'd691c330-77fd-4f63-b197-97c9d7d0ac36', 'bd3172f8-ab32-4a6b-8797-e388bf5eaf46'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:32 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] Delete snapshot completed successfully. Jul 14 21:32:32 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-12f5a4a7-4ad7-4a89-b4ab-6eaeebc25196 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-42e6c48f-00ec-44c8-8e9c-ab3f839fe58b-delete_snapshot" released by "delete_snapshot" :: held 1.738s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:33 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7" returned: 0 in 0.377s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:33 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce 1G Jul 14 21:32:33 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] Acquiring lock "cinder-8696c0bc-89b8-4da1-8b0c-fc31d279629d-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-8696c0bc-89b8-4da1-8b0c-fc31d279629d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] Acquiring lock "cinder-quobyte-8696c0bc-89b8-4da1-8b0c-fc31d279629d" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:33 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-quobyte-8696c0bc-89b8-4da1-8b0c-fc31d279629d" acquired by "delete_volume" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:33 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa9568f-ddce-4695-8d5e-606c42567abc]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:33 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce 1G" returned: 0 in 0.386s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:33 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce Jul 14 21:32:33 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:33 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d Jul 14 21:32:33 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:33 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce" returned: 0 in 0.302s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:33 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce is being set with open permissions: ugo+rw Jul 14 21:32:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:33 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce Jul 14 21:32:33 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:33 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d" returned: 0 in 0.373s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:33 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d Jul 14 21:32:33 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:33 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:34 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce" returned: 0 in 0.296s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:34 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8696c0bc-89b8-4da1-8b0c-fc31d279629d" returned: 0 in 0.278s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-quobyte-8696c0bc-89b8-4da1-8b0c-fc31d279629d" released by "delete_volume" :: held 0.735s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:34 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.info Jul 14 21:32:34 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] Created reservations ['5750feaf-af57-473f-8038-ce86dd573cb8', '46376b4a-3ef8-4636-b6fa-80f2af219435', 'b223707e-fb43-44e4-bc5c-eeffa5fb3a42', '82b28d75-e5fd-4a18-98c8-66e6ac798146'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:34 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:32:34 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:34 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.info" returned: 0 in 0.282s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:34 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.info is being set with open permissions: ugo+rw Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:34 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.info Jul 14 21:32:34 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] Acquiring lock "cinder-71ba4fb2-52a4-44c4-bf1c-7223bc04f866-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:34 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-71ba4fb2-52a4-44c4-bf1c-7223bc04f866-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.274s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:32:34 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] Deleted volume successfully. Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-63188674-4d48-421f-b546-cfb218bba377 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-8696c0bc-89b8-4da1-8b0c-fc31d279629d-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] Acquiring lock "cinder-quobyte-71ba4fb2-52a4-44c4-bf1c-7223bc04f866" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-quobyte-71ba4fb2-52a4-44c4-bf1c-7223bc04f866" acquired by "delete_volume" :: waited 0.013s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8d54b8-4778-40c0-a8e1-f30d39139aa6]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:34 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.info" returned: 0 in 0.283s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.060s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.661s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] Creating offline snapshot 37d18492-7662-41c2-8391-e09d09f2cecb of volume 8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:32:34 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866 Jul 14 21:32:34 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[654c3dc8-0151-4104-aee2-b05e4e7ddffa]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:34 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-366a9080-ba25-46a4-950e-f39cdf2a2ec7 tempest-ProjectReaderTests-904414844 None] Create snapshot completed successfully Jul 14 21:32:34 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 Jul 14 21:32:34 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:34 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866" returned: 0 in 0.363s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:34 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:34 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866 Jul 14 21:32:34 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:35 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2" returned: 0 in 0.403s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-354c58ba-37a6-4807-ba12-7012fe1b93ce-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:35 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb 1G Jul 14 21:32:35 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] Lock "cinder-354c58ba-37a6-4807-ba12-7012fe1b93ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-quobyte-930ad2f1-d898-425a-89e9-478b1fa3cdf7" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-930ad2f1-d898-425a-89e9-478b1fa3cdf7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-quobyte-354c58ba-37a6-4807-ba12-7012fe1b93ce" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-354c58ba-37a6-4807-ba12-7012fe1b93ce" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] Deleting offline snapshot 354c58ba-37a6-4807-ba12-7012fe1b93ce of volume 930ad2f1-d898-425a-89e9-478b1fa3cdf7 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] snapshot_file for this snap is: volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:32:35 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-71ba4fb2-52a4-44c4-bf1c-7223bc04f866" returned: 0 in 0.278s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cf5683-bb64-470c-b481-907f925e5b34]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-quobyte-71ba4fb2-52a4-44c4-bf1c-7223bc04f866" released by "delete_volume" :: held 0.691s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] Created reservations ['668747b8-5bf6-47c4-ae74-ab0f494f1526', 'c590c4ba-4dcd-4d2d-b5da-fc36cc99a337', '928b6a56-96ac-4214-b950-4ef40ce2e254', 'f8d34205-3c69-4591-90bf-451560a91891'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:35 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce Jul 14 21:32:35 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:35 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:32:35 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:35 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb 1G" returned: 0 in 0.442s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:35 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb Jul 14 21:32:35 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:35 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.273s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:32:35 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce" returned: 0 in 0.429s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:32:35 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] Deleted volume successfully. Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d64ba5e-5eb5-4dd7-b67a-bac7d21a9f2b]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-dc15c672-2fa1-4eb6-95fe-34191cbedd20 tempest-SnapshotDependencyTests-2013011214 None] Lock "cinder-71ba4fb2-52a4-44c4-bf1c-7223bc04f866-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:35 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7 Jul 14 21:32:35 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:35 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb" returned: 0 in 0.335s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:35 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb is being set with open permissions: ugo+rw Jul 14 21:32:35 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:35 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb Jul 14 21:32:35 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:36 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7" returned: 0 in 0.401s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:36 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce Jul 14 21:32:36 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:36 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb" returned: 0 in 0.291s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:36 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.info Jul 14 21:32:36 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:36 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.info" returned: 0 in 0.286s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:36 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.info is being set with open permissions: ugo+rw Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:36 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:36 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.info Jul 14 21:32:36 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce" returned: 0 in 0.433s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:36 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce Jul 14 21:32:36 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:36 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:32:36 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:36 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.info" returned: 0 in 0.321s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:36 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7.354c58ba-37a6-4807-ba12-7012fe1b93ce" returned: 0 in 0.325s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:36 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.279s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-354c58ba-37a6-4807-ba12-7012fe1b93ce" released by "_delete_snapshot" :: held 1.715s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:36 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-4402d681-834b-4922-b031-e6c785227c0b tempest-ProjectMemberTests-1217057865 None] Create snapshot completed successfully Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-930ad2f1-d898-425a-89e9-478b1fa3cdf7" released by "delete_snapshot" :: held 1.743s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 28 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 14 21:32:36 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] Created reservations ['45496f65-5315-4b6e-8a53-309af2197f1b', '0250e48a-5182-40ab-808f-70c8f446911f', 'd40657d8-1c23-464a-848e-5c800cd07c45', '7de64916-0df4-4d65-83a2-d6215747b5ea'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:37 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] Delete snapshot completed successfully. Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-808e7e40-06dd-4257-b531-6d2e0bc55085 tempest-ProjectReaderTests-904414844 None] Lock "cinder-354c58ba-37a6-4807-ba12-7012fe1b93ce-delete_snapshot" released by "delete_snapshot" :: held 1.887s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-37d18492-7662-41c2-8391-e09d09f2cecb-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-37d18492-7662-41c2-8391-e09d09f2cecb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-37d18492-7662-41c2-8391-e09d09f2cecb" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-37d18492-7662-41c2-8391-e09d09f2cecb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] Deleting offline snapshot 37d18492-7662-41c2-8391-e09d09f2cecb of volume 8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] snapshot_file for this snap is: volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cd5aad-a182-42cf-84b1-2f043cf40bb5]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-930ad2f1-d898-425a-89e9-478b1fa3cdf7-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] Lock "cinder-930ad2f1-d898-425a-89e9-478b1fa3cdf7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:37 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb Jul 14 21:32:37 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-quobyte-930ad2f1-d898-425a-89e9-478b1fa3cdf7" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-930ad2f1-d898-425a-89e9-478b1fa3cdf7" acquired by "delete_volume" :: waited 0.023s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d10320-36af-4ebe-a4af-84dc129652c2]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:37 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7 Jul 14 21:32:37 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:37 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb" returned: 0 in 0.428s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9026e361-1db9-4f59-8196-d82dd206d0d5]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:37 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 Jul 14 21:32:37 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:37 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7" returned: 0 in 0.387s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:37 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:37 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7 Jul 14 21:32:37 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:38 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-930ad2f1-d898-425a-89e9-478b1fa3cdf7" returned: 0 in 0.252s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:38 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2" returned: 0 in 0.411s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-930ad2f1-d898-425a-89e9-478b1fa3cdf7" released by "delete_volume" :: held 0.716s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:38 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb Jul 14 21:32:38 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] Created reservations ['779f4c99-e15b-43cb-9f40-f696d7bd189f', '909cf5a5-6623-414e-a1f8-5ba76b17e217', '13cd7aa1-9b8a-437e-b0c0-a7861a4fa949', 'fab96bab-c9ff-4637-bbe6-ca1c6d260d95'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:38 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:32:38 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:38 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb" returned: 0 in 0.403s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:38 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:38 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb Jul 14 21:32:38 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.292s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:32:38 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] Deleted volume successfully. Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-4edbf5ec-ef38-4141-9b3c-dc765eea34b7 tempest-ProjectReaderTests-904414844 None] Lock "cinder-930ad2f1-d898-425a-89e9-478b1fa3cdf7-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:38 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2.37d18492-7662-41c2-8391-e09d09f2cecb" returned: 0 in 0.366s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-37d18492-7662-41c2-8391-e09d09f2cecb" released by "_delete_snapshot" :: held 1.736s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:38 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2" released by "delete_snapshot" :: held 1.771s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] Created reservations ['f3a17eb7-58c2-461f-a2ad-844e207e1a02', 'b5dd41c1-fb1f-49df-b48a-46a9b8b50ba2', '09e421a9-2d30-4897-9971-37e7e3b62013', 'dca178be-1f5d-46fc-8e09-3a1da6e0c1ff'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Flow 'volume_create_manager' (c67113d1-bc8a-4e30-b50c-df0eb35d41a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce0f8b5-11d5-49f8-9f01-ca042effafab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce0f8b5-11d5-49f8-9f01-ca042effafab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591309238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b27929-a7f3-417b-b4d9-62401a3855a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5b1c77bd24e17b0068119e76d3e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:39Z,use_quota=True,user_id='bf8a2b7233c0484a9a6d98406d8185c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f13576c8-faf4-4cf3-adec-6789bd29539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f13576c8-faf4-4cf3-adec-6789bd29539d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93cb0e1e-88ba-47cf-b7ba-7082c91d7843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93cb0e1e-88ba-47cf-b7ba-7082c91d7843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54b27929-a7f3-417b-b4d9-62401a3855a8', 'volume_name': 'volume-54b27929-a7f3-417b-b4d9-62401a3855a8', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2364db-fad6-4d72-a2b8-8e2abac280ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2364db-fad6-4d72-a2b8-8e2abac280ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ee5dc8-2e10-4bbf-bd74-203a61dad907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:39 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Volume 54b27929-a7f3-417b-b4d9-62401a3855a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54b27929-a7f3-417b-b4d9-62401a3855a8', 'volume_size': 1} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591309238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b27929-a7f3-417b-b4d9-62401a3855a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5b1c77bd24e17b0068119e76d3e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:39Z,use_quota=True,user_id='bf8a2b7233c0484a9a6d98406d8185c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Creating volume 54b27929-a7f3-417b-b4d9-62401a3855a8 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:32:39 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:39 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] Delete snapshot completed successfully. Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-cb0330af-725f-426a-bbd7-156df2c1e8f7 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-37d18492-7662-41c2-8391-e09d09f2cecb-delete_snapshot" released by "delete_snapshot" :: held 2.086s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:39 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8 1073741824 Jul 14 21:32:39 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2" acquired by "delete_volume" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5f10eb-b8f2-4786-aa1b-deeee26c10c0]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:39 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 Jul 14 21:32:39 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:39 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8 1073741824" returned: 0 in 0.535s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:39 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:39 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8 Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2" returned: 0 in 0.473s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:39 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:39 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2 Jul 14 21:32:40 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:40 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8" returned: 0 in 0.320s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ee5dc8-2e10-4bbf-bd74-203a61dad907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54b27929-a7f3-417b-b4d9-62401a3855a8', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef40cc95-f620-480c-9ac6-2064bdba8f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:40 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Volume volume-54b27929-a7f3-417b-b4d9-62401a3855a8 (54b27929-a7f3-417b-b4d9-62401a3855a8): created successfully Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef40cc95-f620-480c-9ac6-2064bdba8f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Flow 'volume_create_manager' (c67113d1-bc8a-4e30-b50c-df0eb35d41a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:40 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-dd629380-f18b-4fa9-a0f1-21fd42ff81d4 tempest-ProjectReaderTests-904414844 None] Created volume successfully. Jul 14 21:32:40 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2" returned: 0 in 0.327s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2" released by "delete_volume" :: held 0.866s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] Created reservations ['243a4a67-0b04-4db7-bd52-13dda97d4b18', 'f2875310-ed4e-4ac9-aad6-21de0aab92a0', 'c7fb360c-92dd-48fb-985a-2a643ca35ad9', 'a721ce28-4310-4c51-944e-eaec9684a9e0'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:40 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:32:40 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:40 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.287s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:32:40 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] Deleted volume successfully. Jul 14 21:32:40 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-3d16121c-3bbb-4f56-9439-4aa4064e80e1 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-8f6e58c3-64a3-410d-b94a-e6d63d7fd9b2-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (d2aa4f30-2021-432c-9fbb-d86e8f7db763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b067065b-e180-4faf-b931-9d3e66731158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b067065b-e180-4faf-b931-9d3e66731158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-490737809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2223b0fc-29d5-4d23-9edf-c99941a24ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:41Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3939bf-18b0-46e0-b345-68aac0bf59ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3939bf-18b0-46e0-b345-68aac0bf59ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1f4db9-7bc0-4830-ad83-429c97bea7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1f4db9-7bc0-4830-ad83-429c97bea7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2223b0fc-29d5-4d23-9edf-c99941a24ba1', 'volume_name': 'volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e421a7f9-7669-4741-a023-6273cc99c662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e421a7f9-7669-4741-a023-6273cc99c662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c418246c-27e9-46d2-901b-02f15b102565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:41 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Volume 2223b0fc-29d5-4d23-9edf-c99941a24ba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1', 'volume_size': 1} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-490737809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2223b0fc-29d5-4d23-9edf-c99941a24ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:41Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Creating volume 2223b0fc-29d5-4d23-9edf-c99941a24ba1 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:32:41 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:41 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1 1073741824 Jul 14 21:32:41 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:41 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1 1073741824" returned: 0 in 0.494s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:41 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1 Jul 14 21:32:41 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:41 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1" returned: 0 in 0.251s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.403s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c418246c-27e9-46d2-901b-02f15b102565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47c735c-ff67-4560-8b36-477113947e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] Creating offline snapshot ebacedbd-d32d-41a3-921a-7e211917a22c of volume 54b27929-a7f3-417b-b4d9-62401a3855a8 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:32:41 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Volume volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1 (2223b0fc-29d5-4d23-9edf-c99941a24ba1): created successfully Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47c735c-ff67-4560-8b36-477113947e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (d2aa4f30-2021-432c-9fbb-d86e8f7db763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfb681e-a7af-4e4d-931f-94aaeba8688a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:41 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:41 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-62bf5cdc-3ff0-495e-919d-341e1384e763 tempest-ProjectMemberTests-1217057865 None] Created volume successfully. Jul 14 21:32:42 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8 Jul 14 21:32:42 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:42 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8" returned: 0 in 0.400s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:42 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c 1G Jul 14 21:32:42 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:42 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c 1G" returned: 0 in 0.497s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:42 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54b27929-a7f3-417b-b4d9-62401a3855a8 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:42 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54b27929-a7f3-417b-b4d9-62401a3855a8 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c Jul 14 21:32:42 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:43 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54b27929-a7f3-417b-b4d9-62401a3855a8 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c" returned: 0 in 0.341s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:43 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c is being set with open permissions: ugo+rw Jul 14 21:32:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:43 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c Jul 14 21:32:43 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:43 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c" returned: 0 in 0.278s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:43 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.info Jul 14 21:32:43 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:43 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.info" returned: 0 in 0.296s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:43 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.info is being set with open permissions: ugo+rw Jul 14 21:32:43 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:43 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.info Jul 14 21:32:43 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:44 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.info" returned: 0 in 0.260s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.189s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.786s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] Creating offline snapshot aff67b00-a5d8-44b1-8ec6-9a18596de1ff of volume 2223b0fc-29d5-4d23-9edf-c99941a24ba1 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:32:44 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-2710ce44-a583-4b0f-a56a-3889ac61151f tempest-ProjectReaderTests-904414844 None] Create snapshot completed successfully Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca84e3f-f15a-42fc-bb7f-a144c9c25c8d]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:44 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1 Jul 14 21:32:44 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:44 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1" returned: 0 in 0.375s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:44 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff 1G Jul 14 21:32:44 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-ebacedbd-d32d-41a3-921a-7e211917a22c-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] Lock "cinder-ebacedbd-d32d-41a3-921a-7e211917a22c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-quobyte-54b27929-a7f3-417b-b4d9-62401a3855a8" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-54b27929-a7f3-417b-b4d9-62401a3855a8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-quobyte-ebacedbd-d32d-41a3-921a-7e211917a22c" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-ebacedbd-d32d-41a3-921a-7e211917a22c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] Deleting offline snapshot ebacedbd-d32d-41a3-921a-7e211917a22c of volume 54b27929-a7f3-417b-b4d9-62401a3855a8 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] snapshot_file for this snap is: volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3462da-83ac-41b5-80f6-b059f75c7e71]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:44 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c Jul 14 21:32:44 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:44 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff 1G" returned: 0 in 0.444s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:44 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:44 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff Jul 14 21:32:44 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:45 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c" returned: 0 in 0.409s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:45 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54b27929-a7f3-417b-b4d9-62401a3855a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:32:45 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7e3d4e-5246-4dc8-ba06-4050cd87b269]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:45 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff" returned: 0 in 0.338s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:45 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff is being set with open permissions: ugo+rw Jul 14 21:32:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:45 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff Jul 14 21:32:45 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:45 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8 Jul 14 21:32:45 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:45 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff" returned: 0 in 0.288s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:45 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.info Jul 14 21:32:45 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:45 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8" returned: 0 in 0.408s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:45 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c Jul 14 21:32:45 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:45 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.info" returned: 0 in 0.272s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:45 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.info is being set with open permissions: ugo+rw Jul 14 21:32:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:45 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.info Jul 14 21:32:45 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:45 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c" returned: 0 in 0.325s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:45 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:45 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c Jul 14 21:32:45 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:46 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.info" returned: 0 in 0.251s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:46 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-d03d5cce-f751-412e-87b6-801960d35f60 tempest-ProjectMemberTests-1217057865 None] Create snapshot completed successfully Jul 14 21:32:46 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8.ebacedbd-d32d-41a3-921a-7e211917a22c" returned: 0 in 0.242s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-ebacedbd-d32d-41a3-921a-7e211917a22c" released by "_delete_snapshot" :: held 1.492s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-54b27929-a7f3-417b-b4d9-62401a3855a8" released by "delete_snapshot" :: held 1.518s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] Created reservations ['5c0d5af3-0378-4dee-9252-253bb489a6a2', 'd4aec800-eb2c-4edf-806c-659ea15ce943', '7dc9b0e5-18b4-4a67-9722-340c29a50a1a', '5a2c5723-9f31-4d6f-80db-2180b9dcc144'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:46 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] Delete snapshot completed successfully. Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-f36f3de9-b3ee-4148-826b-c1c8d0015a08 tempest-ProjectReaderTests-904414844 None] Lock "cinder-ebacedbd-d32d-41a3-921a-7e211917a22c-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-aff67b00-a5d8-44b1-8ec6-9a18596de1ff-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] Lock "cinder-aff67b00-a5d8-44b1-8ec6-9a18596de1ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-2223b0fc-29d5-4d23-9edf-c99941a24ba1" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-2223b0fc-29d5-4d23-9edf-c99941a24ba1" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-aff67b00-a5d8-44b1-8ec6-9a18596de1ff" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-aff67b00-a5d8-44b1-8ec6-9a18596de1ff" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] Deleting offline snapshot aff67b00-a5d8-44b1-8ec6-9a18596de1ff of volume 2223b0fc-29d5-4d23-9edf-c99941a24ba1 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] snapshot_file for this snap is: volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c1bf6e-b2a3-4c8d-b491-1b0e12c520e9]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:46 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff Jul 14 21:32:46 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-54b27929-a7f3-417b-b4d9-62401a3855a8-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:46 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff" returned: 0 in 0.358s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] Lock "cinder-54b27929-a7f3-417b-b4d9-62401a3855a8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef4bb43-5ba3-4894-af72-027ee5785b61]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] Acquiring lock "cinder-quobyte-54b27929-a7f3-417b-b4d9-62401a3855a8" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:46 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-54b27929-a7f3-417b-b4d9-62401a3855a8" acquired by "delete_volume" :: waited 0.016s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c542a4-8014-41ed-9487-5e867c5ca8c9]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:47 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1 Jul 14 21:32:47 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:47 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8 Jul 14 21:32:47 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:47 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1" returned: 0 in 0.357s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:47 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff Jul 14 21:32:47 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:47 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8" returned: 0 in 0.348s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:47 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8 Jul 14 21:32:47 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:47 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-54b27929-a7f3-417b-b4d9-62401a3855a8" returned: 0 in 0.242s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:47 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff" returned: 0 in 0.338s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] Lock "cinder-quobyte-54b27929-a7f3-417b-b4d9-62401a3855a8" released by "delete_volume" :: held 0.653s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:47 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff Jul 14 21:32:47 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] Created reservations ['ea903e13-54e2-4a2a-9171-1b5c3825f840', 'ec60d5e5-751d-471d-af87-e51a8d07b969', '0e4b73e1-1794-4054-982f-735fd70a21d2', '90522aa6-ec67-4601-b6ba-efbea483372d'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:47 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:32:47 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:47 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1.aff67b00-a5d8-44b1-8ec6-9a18596de1ff" returned: 0 in 0.254s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-aff67b00-a5d8-44b1-8ec6-9a18596de1ff" released by "_delete_snapshot" :: held 1.407s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-2223b0fc-29d5-4d23-9edf-c99941a24ba1" released by "delete_snapshot" :: held 1.430s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:47 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] Created reservations ['24e40c42-574d-406e-9318-6ed59797b89e', 'f7c64578-02d9-4ce7-b40e-099de36475fe', 'e49e9d57-362b-4b41-b00e-3231408ed831', 'e0f7043d-3e4e-42dc-85e1-2f38817e891f'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:48 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.291s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:48 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:32:48 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] Deleted volume successfully. Jul 14 21:32:48 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] Delete snapshot completed successfully. Jul 14 21:32:48 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ae82687c-140a-4a6c-bbf8-f8b3566b65ce tempest-ProjectMemberTests-1217057865 None] Lock "cinder-aff67b00-a5d8-44b1-8ec6-9a18596de1ff-delete_snapshot" released by "delete_snapshot" :: held 1.595s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:48 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b5c56b05-ba72-4ae2-bda2-e087bc65003e tempest-ProjectReaderTests-904414844 None] Lock "cinder-54b27929-a7f3-417b-b4d9-62401a3855a8-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:48 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-2223b0fc-29d5-4d23-9edf-c99941a24ba1-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:48 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-2223b0fc-29d5-4d23-9edf-c99941a24ba1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:48 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:UPDATE=239,cinder:DELETE=21,cinder:SELECT=190,cinder:INSERT=70 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:32:48 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=182,cinder:UPDATE=237,cinder:INSERT=59,cinder:DELETE=20 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:32:48 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-2223b0fc-29d5-4d23-9edf-c99941a24ba1" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:48 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-2223b0fc-29d5-4d23-9edf-c99941a24ba1" acquired by "delete_volume" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:48 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa13a52-69a9-4a38-95fb-3e6c0d083354]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:48 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:48 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1 Jul 14 21:32:48 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:49 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1" returned: 0 in 0.377s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:49 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1 Jul 14 21:32:49 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:49 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-2223b0fc-29d5-4d23-9edf-c99941a24ba1" returned: 0 in 0.247s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:49 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-2223b0fc-29d5-4d23-9edf-c99941a24ba1" released by "delete_volume" :: held 0.687s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:49 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] Created reservations ['ec73c84f-fe9a-4e99-b08f-030c11c21bc7', '97839685-2be3-4afc-89b5-1b6cc7588856', 'a5f2e6c1-fe16-48e7-879a-f3a2bc4eb8be', '099a1067-b47e-408f-bab9-c22be5da2915'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:49 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:49 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:32:49 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:49 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:49 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.285s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:49 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:32:49 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] Deleted volume successfully. Jul 14 21:32:49 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-930deca7-dc75-4b05-8731-05af1aac7d83 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-2223b0fc-29d5-4d23-9edf-c99941a24ba1-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (7a60ca19-9d88-4324-9be0-b6d4f934d3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cea79c8-dc77-4ce4-bd03-35cb9e10b777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cea79c8-dc77-4ce4-bd03-35cb9e10b777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139504436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6516ab-73e3-4e5b-a768-cf0f6eb86c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:50Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b9dfcb1-a919-4828-a3bd-f80df8403fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b9dfcb1-a919-4828-a3bd-f80df8403fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6abe89f-7715-45c3-8fd1-2dd6e478988c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6abe89f-7715-45c3-8fd1-2dd6e478988c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e6516ab-73e3-4e5b-a768-cf0f6eb86c38', 'volume_name': 'volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0bb6ff-a269-4d51-a682-981a39e49560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0bb6ff-a269-4d51-a682-981a39e49560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6127620e-0c3b-43c4-ad2d-01f539de20e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:50 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Volume 4e6516ab-73e3-4e5b-a768-cf0f6eb86c38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38', 'volume_size': 1} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139504436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6516ab-73e3-4e5b-a768-cf0f6eb86c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:50Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Creating volume 4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:32:50 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:50 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 1073741824 Jul 14 21:32:50 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:50 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 1073741824" returned: 0 in 0.452s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:50 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:50 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 Jul 14 21:32:50 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:51 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38" returned: 0 in 0.250s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:32:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6127620e-0c3b-43c4-ad2d-01f539de20e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2019ac55-1e27-440b-b3c6-c5757f726d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:51 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Volume volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 (4e6516ab-73e3-4e5b-a768-cf0f6eb86c38): created successfully Jul 14 21:32:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2019ac55-1e27-440b-b3c6-c5757f726d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:51 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (7a60ca19-9d88-4324-9be0-b6d4f934d3ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:51 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-5e40c0c5-cd35-4af0-850a-06c3d6189cf1 tempest-ProjectMemberTests-1217057865 None] Created volume successfully. Jul 14 21:32:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:51 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] Creating offline snapshot dfad7fe7-9f7a-438f-8c6d-c28c8f191e79 of volume 4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:32:51 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be5c951-efbe-4176-8b5a-fecc02df6137]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:51 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 Jul 14 21:32:51 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:51 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38" returned: 0 in 0.385s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:51 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:51 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79 1G Jul 14 21:32:51 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:52 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79 1G" returned: 0 in 0.410s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:52 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79 Jul 14 21:32:52 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:52 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79" returned: 0 in 0.302s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:52 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79 is being set with open permissions: ugo+rw Jul 14 21:32:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:52 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79 Jul 14 21:32:52 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:52 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79" returned: 0 in 0.257s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:52 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:52 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.info Jul 14 21:32:52 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:53 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.info" returned: 0 in 0.255s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:53 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.info is being set with open permissions: ugo+rw Jul 14 21:32:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:53 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.info Jul 14 21:32:53 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:53 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.info" returned: 0 in 0.251s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:53 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-92ebe9c0-0c6d-438c-8250-54b9ae9d0166 tempest-ProjectMemberTests-1217057865 None] Create snapshot completed successfully Jul 14 21:32:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-dfad7fe7-9f7a-438f-8c6d-c28c8f191e79-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-dfad7fe7-9f7a-438f-8c6d-c28c8f191e79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-dfad7fe7-9f7a-438f-8c6d-c28c8f191e79" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:53 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-dfad7fe7-9f7a-438f-8c6d-c28c8f191e79" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] Deleting offline snapshot dfad7fe7-9f7a-438f-8c6d-c28c8f191e79 of volume 4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:32:53 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] snapshot_file for this snap is: volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:32:53 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c439403-2c5c-4965-8eaf-cb6d7bd0fd7f]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:53 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:53 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79 Jul 14 21:32:53 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:54 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79" returned: 0 in 0.391s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:54 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:32:54 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea52b0af-c97a-4af2-a317-cc03946ca923]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:54 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 Jul 14 21:32:54 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:54 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38" returned: 0 in 0.346s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:54 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79 Jul 14 21:32:54 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:54 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79" returned: 0 in 0.333s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:54 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79 Jul 14 21:32:54 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:54 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:54 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38.dfad7fe7-9f7a-438f-8c6d-c28c8f191e79" returned: 0 in 0.235s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-dfad7fe7-9f7a-438f-8c6d-c28c8f191e79" released by "_delete_snapshot" :: held 1.395s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38" released by "delete_snapshot" :: held 1.420s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:55 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] Created reservations ['2c016118-b771-4357-bdac-1cb2674ddf55', '45dabde2-0d9d-420c-b644-debf1c9b3fe6', '1e346052-10bb-4a13-8721-998c5f255b84', '244a98b3-b50f-49b9-b4d4-6d3e5e20383f'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:55 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] Delete snapshot completed successfully. Jul 14 21:32:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-ea89c2b7-2821-4df7-b73f-210e60744962 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-dfad7fe7-9f7a-438f-8c6d-c28c8f191e79-delete_snapshot" released by "delete_snapshot" :: held 1.551s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:32:55 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38" acquired by "delete_volume" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:32:55 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[5148f755-fe7a-478c-b329-83107bb09ab7]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:55 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:55 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 Jul 14 21:32:55 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:56 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38" returned: 0 in 0.342s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:56 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38 Jul 14 21:32:56 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:56 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38" returned: 0 in 0.242s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38" released by "delete_volume" :: held 0.638s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:56 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] Created reservations ['bc1579dc-1d0f-4859-bb54-4497705ac332', 'eaa0aeae-152f-4970-ad19-89d4143a4e44', '0a822da1-e125-481c-abf1-2196e865078a', 'f0d76382-0e8f-4fe1-89c4-2604f3339d0b'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:32:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:56 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:56 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:32:56 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:56 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:56 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.250s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:56 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:32:56 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] Deleted volume successfully. Jul 14 21:32:56 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-c0cd0a0d-6fc5-4d9a-9251-ec257a8c5e44 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-4e6516ab-73e3-4e5b-a768-cf0f6eb86c38-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (97002c09-4197-4713-99e4-0ca882f48910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7bdd749-f599-4c10-ac79-e48af6ef20a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7bdd749-f599-4c10-ac79-e48af6ef20a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-141130892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daddc5f1-eeed-42cb-b806-c65309036ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:57Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44dc9d9d-6708-4672-9d3f-12f520fa6d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44dc9d9d-6708-4672-9d3f-12f520fa6d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6d42c4-ba55-4b45-b156-bc047d7d9439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6d42c4-ba55-4b45-b156-bc047d7d9439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daddc5f1-eeed-42cb-b806-c65309036ed7', 'volume_name': 'volume-daddc5f1-eeed-42cb-b806-c65309036ed7', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831f20a2-c566-4b17-8e9e-5df2d6d6f5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831f20a2-c566-4b17-8e9e-5df2d6d6f5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea30a519-b41d-41bd-811b-e6a3425fea4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:57 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Volume daddc5f1-eeed-42cb-b806-c65309036ed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daddc5f1-eeed-42cb-b806-c65309036ed7', 'volume_size': 1} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-141130892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daddc5f1-eeed-42cb-b806-c65309036ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad4cfd5dbc44a34b0e07301e543ade7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:32:57Z,use_quota=True,user_id='f1c582838f0e4ce489b556d0e150b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Creating volume daddc5f1-eeed-42cb-b806-c65309036ed7 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:32:57 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:57 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7 1073741824 Jul 14 21:32:57 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:57 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7 1073741824" returned: 0 in 0.394s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:57 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:57 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7 Jul 14 21:32:57 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:58 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7" returned: 0 in 0.238s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:32:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:32:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea30a519-b41d-41bd-811b-e6a3425fea4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daddc5f1-eeed-42cb-b806-c65309036ed7', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd7e46e-3914-43b1-87d3-aef3bbf74552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:32:58 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Volume volume-daddc5f1-eeed-42cb-b806-c65309036ed7 (daddc5f1-eeed-42cb-b806-c65309036ed7): created successfully Jul 14 21:32:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd7e46e-3914-43b1-87d3-aef3bbf74552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:32:58 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Flow 'volume_create_manager' (97002c09-4197-4713-99e4-0ca882f48910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:32:58 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-dac0ea37-dd8d-4c0f-88a3-5a455519d136 tempest-ProjectMemberTests-1217057865 None] Created volume successfully. Jul 14 21:32:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:32:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:32:58 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] Creating offline snapshot 6bebaecc-8e53-47a3-9af8-5bbd0d914996 of volume daddc5f1-eeed-42cb-b806-c65309036ed7 {{(pid=88300) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 14 21:32:58 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[396f3f8d-6a5a-4c5c-a47b-ca86f3faeb43]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:32:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:58 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7 Jul 14 21:32:58 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:58 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7" returned: 0 in 0.358s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:58 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996 1G {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:58 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996 1G Jul 14 21:32:58 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:59 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996 1G" returned: 0 in 0.374s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daddc5f1-eeed-42cb-b806-c65309036ed7 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:59 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daddc5f1-eeed-42cb-b806-c65309036ed7 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996 Jul 14 21:32:59 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:59 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daddc5f1-eeed-42cb-b806-c65309036ed7 -F qcow2 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996" returned: 0 in 0.280s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:59 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996 is being set with open permissions: ugo+rw Jul 14 21:32:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:59 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996 Jul 14 21:32:59 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:59 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996" returned: 0 in 0.237s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:32:59 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.info Jul 14 21:32:59 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:32:59 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Jul 14 21:32:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.info" returned: 0 in 0.241s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:32:59 devstack cinder-volume[88300]: WARNING cinder.volume.drivers.remotefs [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.info is being set with open permissions: ugo+rw Jul 14 21:32:59 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.info {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:00 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.info Jul 14 21:33:00 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:00 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.info" returned: 0 in 0.240s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.805s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:33:00 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-860039d6-81d5-4993-a1cb-ae8e6166b821 tempest-ProjectMemberTests-1217057865 None] Create snapshot completed successfully Jul 14 21:33:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-6bebaecc-8e53-47a3-9af8-5bbd0d914996-delete_snapshot" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:33:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-6bebaecc-8e53-47a3-9af8-5bbd0d914996-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:33:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-daddc5f1-eeed-42cb-b806-c65309036ed7" by "delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:33:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-daddc5f1-eeed-42cb-b806-c65309036ed7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:33:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-6bebaecc-8e53-47a3-9af8-5bbd0d914996" by "_delete_snapshot" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:33:00 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-6bebaecc-8e53-47a3-9af8-5bbd0d914996" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:33:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] Deleting offline snapshot 6bebaecc-8e53-47a3-9af8-5bbd0d914996 of volume daddc5f1-eeed-42cb-b806-c65309036ed7 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 14 21:33:00 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] snapshot_file for this snap is: volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996 {{(pid=88300) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 14 21:33:00 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63a6783-b96e-4aa4-9d8e-7b67455a934a]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:33:00 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:00 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996 Jul 14 21:33:00 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:01 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996" returned: 0 in 0.346s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:01 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daddc5f1-eeed-42cb-b806-c65309036ed7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88300) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 14 21:33:01 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f17f47e-c3e8-401d-a50b-be07d5d29cea]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:33:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:01 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7 Jul 14 21:33:01 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:01 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7" returned: 0 in 0.340s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:01 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996 Jul 14 21:33:01 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:01 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996" returned: 0 in 0.331s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:01 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:01 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996 Jul 14 21:33:01 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:02 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7.6bebaecc-8e53-47a3-9af8-5bbd0d914996" returned: 0 in 0.237s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-6bebaecc-8e53-47a3-9af8-5bbd0d914996" released by "_delete_snapshot" :: held 1.337s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:33:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-daddc5f1-eeed-42cb-b806-c65309036ed7" released by "delete_snapshot" :: held 1.356s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:33:02 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] Created reservations ['0879fa23-fc00-4d50-85c1-75954d02ee6b', 'a6c9a0aa-3ba1-4f97-be31-f8d468ff43b7', '9edbbe11-0816-4b64-a21b-5a246d4e29ed', '4e753687-0a04-4038-8605-703195a9fed7'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:33:02 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] Delete snapshot completed successfully. Jul 14 21:33:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-69cfc17f-f3e4-40bb-8c6a-7ac9ce373450 tempest-ProjectMemberTests-1217057865 None] Lock "cinder-6bebaecc-8e53-47a3-9af8-5bbd0d914996-delete_snapshot" released by "delete_snapshot" :: held 1.485s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:33:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-daddc5f1-eeed-42cb-b806-c65309036ed7-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:33:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] Lock "cinder-daddc5f1-eeed-42cb-b806-c65309036ed7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:33:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] Acquiring lock "cinder-quobyte-daddc5f1-eeed-42cb-b806-c65309036ed7" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:33:02 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-daddc5f1-eeed-42cb-b806-c65309036ed7" acquired by "delete_volume" :: waited 0.013s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:33:02 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[806511ea-d8bd-405f-ab91-6967f7f3432b]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:33:02 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:03 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7 Jul 14 21:33:03 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:03 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7" returned: 0 in 0.348s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:03 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7 Jul 14 21:33:03 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:03 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-daddc5f1-eeed-42cb-b806-c65309036ed7" returned: 0 in 0.235s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] Lock "cinder-quobyte-daddc5f1-eeed-42cb-b806-c65309036ed7" released by "delete_volume" :: held 0.636s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:33:03 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] Created reservations ['ac34923e-4e72-4101-a097-7af9420ebd77', 'c60e2055-f66a-49fd-bbee-46600889478b', '4258fa78-a19d-44d0-9464-819df6b1c99b', '8083799f-508b-4656-b6d6-34a80e8547da'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:33:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:33:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:33:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:33:03 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:33:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:33:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:03 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:33:03 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:03 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:03 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.243s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:03 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:33:03 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] Deleted volume successfully. Jul 14 21:33:03 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-b6906dff-ed2d-446f-865c-37c28ce290fa tempest-ProjectMemberTests-1217057865 None] Lock "cinder-daddc5f1-eeed-42cb-b806-c65309036ed7-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Flow 'volume_create_manager' (cc6bcf44-d773-4ed9-9ad5-97c53b72f3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c43e491-570a-405f-8006-73d9958598b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c43e491-570a-405f-8006-73d9958598b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1485553632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8881036b-1cce-4a63-9cb2-07d3bdaaac1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09600562bda447a1a4a0a937b64f2174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:33:07Z,use_quota=True,user_id='1ee8e4f6b3824d358acd6e5fe09fe20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f39a07-8c0b-4e20-9926-49ac85cfa1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f39a07-8c0b-4e20-9926-49ac85cfa1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66350c9-13c6-4f00-ac7d-2ae4bf1a0495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66350c9-13c6-4f00-ac7d-2ae4bf1a0495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8881036b-1cce-4a63-9cb2-07d3bdaaac1c', 'volume_name': 'volume-8881036b-1cce-4a63-9cb2-07d3bdaaac1c', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7418e261-62db-456e-9ca3-d552275843c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7418e261-62db-456e-9ca3-d552275843c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6969b3c6-04e4-4871-aee7-7c717af3629d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:07 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Volume 8881036b-1cce-4a63-9cb2-07d3bdaaac1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8881036b-1cce-4a63-9cb2-07d3bdaaac1c', 'volume_size': 1} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1485553632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8881036b-1cce-4a63-9cb2-07d3bdaaac1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09600562bda447a1a4a0a937b64f2174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:33:07Z,use_quota=True,user_id='1ee8e4f6b3824d358acd6e5fe09fe20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Creating volume 8881036b-1cce-4a63-9cb2-07d3bdaaac1c {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:33:07 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8881036b-1cce-4a63-9cb2-07d3bdaaac1c 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:07 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8881036b-1cce-4a63-9cb2-07d3bdaaac1c 1073741824 Jul 14 21:33:07 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:07 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8881036b-1cce-4a63-9cb2-07d3bdaaac1c 1073741824" returned: 0 in 0.403s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:07 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8881036b-1cce-4a63-9cb2-07d3bdaaac1c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:07 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8881036b-1cce-4a63-9cb2-07d3bdaaac1c Jul 14 21:33:07 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:08 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8881036b-1cce-4a63-9cb2-07d3bdaaac1c" returned: 0 in 0.234s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:08 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:33:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:33:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6969b3c6-04e4-4871-aee7-7c717af3629d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8881036b-1cce-4a63-9cb2-07d3bdaaac1c', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd20cb6b-240e-452c-96a3-58d12e3053e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:08 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Volume volume-8881036b-1cce-4a63-9cb2-07d3bdaaac1c (8881036b-1cce-4a63-9cb2-07d3bdaaac1c): created successfully Jul 14 21:33:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd20cb6b-240e-452c-96a3-58d12e3053e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:08 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Flow 'volume_create_manager' (cc6bcf44-d773-4ed9-9ad5-97c53b72f3ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:33:08 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-0b073f9a-ad05-449c-8c45-beb1bf733a4b tempest-ProjectReaderTests-971322714 None] Created volume successfully. Jul 14 21:33:08 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] Acquiring lock "cinder-8881036b-1cce-4a63-9cb2-07d3bdaaac1c-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:33:08 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] Lock "cinder-8881036b-1cce-4a63-9cb2-07d3bdaaac1c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:33:08 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] Acquiring lock "cinder-quobyte-8881036b-1cce-4a63-9cb2-07d3bdaaac1c" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:33:08 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] Lock "cinder-quobyte-8881036b-1cce-4a63-9cb2-07d3bdaaac1c" acquired by "delete_volume" :: waited 0.015s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:33:08 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[422432e4-2638-48cf-80df-91bf50cc18fb]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:33:08 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8881036b-1cce-4a63-9cb2-07d3bdaaac1c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:08 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8881036b-1cce-4a63-9cb2-07d3bdaaac1c Jul 14 21:33:08 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:09 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8881036b-1cce-4a63-9cb2-07d3bdaaac1c" returned: 0 in 0.347s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8881036b-1cce-4a63-9cb2-07d3bdaaac1c {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:09 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8881036b-1cce-4a63-9cb2-07d3bdaaac1c Jul 14 21:33:09 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:09 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-8881036b-1cce-4a63-9cb2-07d3bdaaac1c" returned: 0 in 0.240s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] Lock "cinder-quobyte-8881036b-1cce-4a63-9cb2-07d3bdaaac1c" released by "delete_volume" :: held 0.624s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:33:09 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] Created reservations ['9b32dc51-e64b-4747-baf9-84ac58f4f3ee', '8644af09-f6e2-459d-8478-bd83936e24ec', 'd762ba2f-e153-43ef-8629-507f3a408db9', 'ef6a3728-8e11-41ce-b125-329ab79eeecc'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:33:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:33:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:33:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:33:09 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:33:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:33:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:09 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:33:09 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:09 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:09 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.245s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:09 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:33:09 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] Deleted volume successfully. Jul 14 21:33:09 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-78668607-9747-45a5-9b19-e827271401e5 tempest-ProjectReaderTests-971322714 None] Lock "cinder-8881036b-1cce-4a63-9cb2-07d3bdaaac1c-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Flow 'volume_create_manager' (bc85f58a-46a6-4157-ace0-e220e73e2863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26ea92e-627d-4c1c-a058-18b8e0819022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26ea92e-627d-4c1c-a058-18b8e0819022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1565558334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa616d4-c7bc-4488-9407-4f24c7cfb4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09600562bda447a1a4a0a937b64f2174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:33:10Z,use_quota=True,user_id='1ee8e4f6b3824d358acd6e5fe09fe20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea29f6d3-c29d-4bc3-9cba-1183c9cee865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea29f6d3-c29d-4bc3-9cba-1183c9cee865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed397226-7d67-416b-85d8-4e700a67ac2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed397226-7d67-416b-85d8-4e700a67ac2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caa616d4-c7bc-4488-9407-4f24c7cfb4e7', 'volume_name': 'volume-caa616d4-c7bc-4488-9407-4f24c7cfb4e7', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a451d7b0-98ca-480d-a6c6-648b8fb94d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a451d7b0-98ca-480d-a6c6-648b8fb94d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75cf78cf-6c25-4268-9517-ea5ec0eb6b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:10 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Volume caa616d4-c7bc-4488-9407-4f24c7cfb4e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caa616d4-c7bc-4488-9407-4f24c7cfb4e7', 'volume_size': 1} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1565558334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa616d4-c7bc-4488-9407-4f24c7cfb4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09600562bda447a1a4a0a937b64f2174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:33:10Z,use_quota=True,user_id='1ee8e4f6b3824d358acd6e5fe09fe20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Creating volume caa616d4-c7bc-4488-9407-4f24c7cfb4e7 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:33:10 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-caa616d4-c7bc-4488-9407-4f24c7cfb4e7 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:10 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-caa616d4-c7bc-4488-9407-4f24c7cfb4e7 1073741824 Jul 14 21:33:10 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:10 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-caa616d4-c7bc-4488-9407-4f24c7cfb4e7 1073741824" returned: 0 in 0.402s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-caa616d4-c7bc-4488-9407-4f24c7cfb4e7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:10 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-caa616d4-c7bc-4488-9407-4f24c7cfb4e7 Jul 14 21:33:10 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:10 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-caa616d4-c7bc-4488-9407-4f24c7cfb4e7" returned: 0 in 0.244s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75cf78cf-6c25-4268-9517-ea5ec0eb6b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caa616d4-c7bc-4488-9407-4f24c7cfb4e7', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ae1b44-8f14-4115-b4b6-7858cad94b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:10 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Volume volume-caa616d4-c7bc-4488-9407-4f24c7cfb4e7 (caa616d4-c7bc-4488-9407-4f24c7cfb4e7): created successfully Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ae1b44-8f14-4115-b4b6-7858cad94b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:10 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Flow 'volume_create_manager' (bc85f58a-46a6-4157-ace0-e220e73e2863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:33:10 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-e28810d3-ef76-45a1-bb36-6405117a6bb4 tempest-ProjectReaderTests-971322714 None] Created volume successfully. Jul 14 21:33:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] Acquiring lock "cinder-caa616d4-c7bc-4488-9407-4f24c7cfb4e7-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:33:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] Lock "cinder-caa616d4-c7bc-4488-9407-4f24c7cfb4e7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:33:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] Acquiring lock "cinder-quobyte-caa616d4-c7bc-4488-9407-4f24c7cfb4e7" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:33:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] Lock "cinder-quobyte-caa616d4-c7bc-4488-9407-4f24c7cfb4e7" acquired by "delete_volume" :: waited 0.013s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:33:11 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60316b6-e59b-4335-98a6-a5335d7c6934]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:33:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-caa616d4-c7bc-4488-9407-4f24c7cfb4e7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:11 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-caa616d4-c7bc-4488-9407-4f24c7cfb4e7 Jul 14 21:33:11 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:11 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-caa616d4-c7bc-4488-9407-4f24c7cfb4e7" returned: 0 in 0.373s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-caa616d4-c7bc-4488-9407-4f24c7cfb4e7 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:11 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-caa616d4-c7bc-4488-9407-4f24c7cfb4e7 Jul 14 21:33:11 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:11 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:11 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-caa616d4-c7bc-4488-9407-4f24c7cfb4e7" returned: 0 in 0.271s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:11 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] Lock "cinder-quobyte-caa616d4-c7bc-4488-9407-4f24c7cfb4e7" released by "delete_volume" :: held 0.684s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] Created reservations ['788243e3-1ce9-4dfa-8d9c-39f8e04b97bf', 'fd6948a4-4e74-427c-9ce4-5ae6ab6bee43', '5964f9be-1ba7-4915-a887-a6c00191ed2b', 'e1254b8d-c68d-464c-8e9f-4a54896ad037'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:12 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:33:12 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:12 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.242s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:33:12 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] Deleted volume successfully. Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-18fedb1c-b8c1-44ee-ab5a-944ee77406cd tempest-ProjectReaderTests-971322714 None] Lock "cinder-caa616d4-c7bc-4488-9407-4f24c7cfb4e7-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Flow 'volume_create_manager' (938cb199-3287-4a4a-aa73-dbec1452d2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e9ac5a0-b57d-4104-a678-48300ec85f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e9ac5a0-b57d-4104-a678-48300ec85f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873791603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd165d07-95a8-4550-9d06-b59d39572545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09600562bda447a1a4a0a937b64f2174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:33:13Z,use_quota=True,user_id='1ee8e4f6b3824d358acd6e5fe09fe20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b930071d-cf84-4ee6-aed5-f22d6056a75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b930071d-cf84-4ee6-aed5-f22d6056a75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eae6aef-fe82-4758-8a14-acdb09d5206c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eae6aef-fe82-4758-8a14-acdb09d5206c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd165d07-95a8-4550-9d06-b59d39572545', 'volume_name': 'volume-cd165d07-95a8-4550-9d06-b59d39572545', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8fb801-f1b7-41ee-a345-a217bc9a497c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8fb801-f1b7-41ee-a345-a217bc9a497c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b91b0a1-480b-423d-abf0-46a1e1edae26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:12 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Volume cd165d07-95a8-4550-9d06-b59d39572545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd165d07-95a8-4550-9d06-b59d39572545', 'volume_size': 1} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873791603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd165d07-95a8-4550-9d06-b59d39572545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09600562bda447a1a4a0a937b64f2174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:33:13Z,use_quota=True,user_id='1ee8e4f6b3824d358acd6e5fe09fe20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Creating volume cd165d07-95a8-4550-9d06-b59d39572545 {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:33:12 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:33:12 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd165d07-95a8-4550-9d06-b59d39572545 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:12 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd165d07-95a8-4550-9d06-b59d39572545 1073741824 Jul 14 21:33:12 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:13 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd165d07-95a8-4550-9d06-b59d39572545 1073741824" returned: 0 in 0.393s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd165d07-95a8-4550-9d06-b59d39572545 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:13 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd165d07-95a8-4550-9d06-b59d39572545 Jul 14 21:33:13 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:13 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd165d07-95a8-4550-9d06-b59d39572545" returned: 0 in 0.241s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:13 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:33:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:33:13 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b91b0a1-480b-423d-abf0-46a1e1edae26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd165d07-95a8-4550-9d06-b59d39572545', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:13 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d205707b-57c6-47d0-bed8-f7b020f02f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:13 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Volume volume-cd165d07-95a8-4550-9d06-b59d39572545 (cd165d07-95a8-4550-9d06-b59d39572545): created successfully Jul 14 21:33:13 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d205707b-57c6-47d0-bed8-f7b020f02f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:13 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Flow 'volume_create_manager' (938cb199-3287-4a4a-aa73-dbec1452d2f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:33:13 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-57d2129a-97e2-4663-a244-0f6b2bdf73c3 tempest-ProjectReaderTests-971322714 None] Created volume successfully. Jul 14 21:33:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] Acquiring lock "cinder-cd165d07-95a8-4550-9d06-b59d39572545-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:33:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] Lock "cinder-cd165d07-95a8-4550-9d06-b59d39572545-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:33:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] Acquiring lock "cinder-quobyte-cd165d07-95a8-4550-9d06-b59d39572545" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:33:13 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] Lock "cinder-quobyte-cd165d07-95a8-4550-9d06-b59d39572545" acquired by "delete_volume" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:33:13 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ea7c78-5fa6-4f40-9ff7-ebfbf8d6978f]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:33:13 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd165d07-95a8-4550-9d06-b59d39572545 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:14 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd165d07-95a8-4550-9d06-b59d39572545 Jul 14 21:33:14 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:14 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd165d07-95a8-4550-9d06-b59d39572545" returned: 0 in 0.355s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd165d07-95a8-4550-9d06-b59d39572545 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:14 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd165d07-95a8-4550-9d06-b59d39572545 Jul 14 21:33:14 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:14 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-cd165d07-95a8-4550-9d06-b59d39572545" returned: 0 in 0.238s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] Lock "cinder-quobyte-cd165d07-95a8-4550-9d06-b59d39572545" released by "delete_volume" :: held 0.631s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:33:14 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] Created reservations ['e1321ce1-dd2b-4ce3-9dde-db31491d4435', 'bf08494d-a2cb-4a90-85d7-3179efac32a8', '4d47a874-4939-4926-9a63-ded363af56c3', '36ec7c9e-2e0c-48a3-84d7-2078b19001c3'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:33:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:33:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:33:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:33:14 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:33:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:33:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:14 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:33:14 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:14 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:14 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.241s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:14 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:33:14 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] Deleted volume successfully. Jul 14 21:33:14 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-8b1245fc-e225-4e6e-a82f-6fb375156049 tempest-ProjectReaderTests-971322714 None] Lock "cinder-cd165d07-95a8-4550-9d06-b59d39572545-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88300) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Flow 'volume_create_manager' (a12d1724-01d4-4116-adb5-7f547afca0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3937dfde-d4c0-439b-9c80-6ce6290af08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3937dfde-d4c0-439b-9c80-6ce6290af08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1308763417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b28637-21e8-48bf-b1d8-106a2b1c833a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09600562bda447a1a4a0a937b64f2174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:33:15Z,use_quota=True,user_id='1ee8e4f6b3824d358acd6e5fe09fe20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851bfa72-c824-477d-a7a1-3a2bd07d09b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851bfa72-c824-477d-a7a1-3a2bd07d09b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c246d82-f41f-4a74-9b21-e68049d955ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c246d82-f41f-4a74-9b21-e68049d955ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0b28637-21e8-48bf-b1d8-106a2b1c833a', 'volume_name': 'volume-e0b28637-21e8-48bf-b1d8-106a2b1c833a', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5144fe3c-83e0-4abd-8b15-63f4d429c3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5144fe3c-83e0-4abd-8b15-63f4d429c3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f60d19-3366-4d80-a96c-654e9723be0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:15 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Volume e0b28637-21e8-48bf-b1d8-106a2b1c833a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0b28637-21e8-48bf-b1d8-106a2b1c833a', 'volume_size': 1} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-14T19:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1308763417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b28637-21e8-48bf-b1d8-106a2b1c833a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09600562bda447a1a4a0a937b64f2174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T19:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T19:33:15Z,use_quota=True,user_id='1ee8e4f6b3824d358acd6e5fe09fe20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(497ef7ee-d99b-4ab5-93bc-46c02484604a),volume_type_id=497ef7ee-d99b-4ab5-93bc-46c02484604a)}" {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.remotefs [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Creating volume e0b28637-21e8-48bf-b1d8-106a2b1c833a {{(pid=88300) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Selected osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 as target Quobyte volume. {{(pid=88300) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 14 21:33:15 devstack cinder-volume[88300]: INFO cinder.volume.drivers.remotefs [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] casted to osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8 Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e0b28637-21e8-48bf-b1d8-106a2b1c833a 1073741824 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:15 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e0b28637-21e8-48bf-b1d8-106a2b1c833a 1073741824 Jul 14 21:33:15 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:15 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e0b28637-21e8-48bf-b1d8-106a2b1c833a 1073741824" returned: 0 in 0.401s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:15 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e0b28637-21e8-48bf-b1d8-106a2b1c833a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:15 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e0b28637-21e8-48bf-b1d8-106a2b1c833a Jul 14 21:33:15 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:16 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e0b28637-21e8-48bf-b1d8-106a2b1c833a" returned: 0 in 0.239s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:16 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'} {{(pid=88300) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 14 21:33:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:33:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f60d19-3366-4d80-a96c-654e9723be0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0b28637-21e8-48bf-b1d8-106a2b1c833a', 'volume_size': 1}' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc64c803-82f6-4a70-b7bd-22fc74c0aa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 14 21:33:16 devstack cinder-volume[88300]: INFO cinder.volume.flows.manager.create_volume [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Volume volume-e0b28637-21e8-48bf-b1d8-106a2b1c833a (e0b28637-21e8-48bf-b1d8-106a2b1c833a): created successfully Jul 14 21:33:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc64c803-82f6-4a70-b7bd-22fc74c0aa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88300) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 14 21:33:16 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Flow 'volume_create_manager' (a12d1724-01d4-4116-adb5-7f547afca0c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88300) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 14 21:33:16 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-96c274d0-e41d-45f6-8767-58c6f5850643 tempest-ProjectReaderTests-971322714 None] Created volume successfully. Jul 14 21:33:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] Acquiring lock "cinder-e0b28637-21e8-48bf-b1d8-106a2b1c833a-delete_volume" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:33:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] Lock "cinder-e0b28637-21e8-48bf-b1d8-106a2b1c833a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:33:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] Acquiring lock "cinder-quobyte-e0b28637-21e8-48bf-b1d8-106a2b1c833a" by "delete_volume" {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 14 21:33:16 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] Lock "cinder-quobyte-e0b28637-21e8-48bf-b1d8-106a2b1c833a" acquired by "delete_volume" :: waited 0.014s {{(pid=88300) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 14 21:33:16 devstack cinder-volume[88300]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a5b23c-d462-4d30-909d-c8ceddb74c54]: (4, 'qcow2') {{(pid=89528) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 14 21:33:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e0b28637-21e8-48bf-b1d8-106a2b1c833a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:16 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e0b28637-21e8-48bf-b1d8-106a2b1c833a Jul 14 21:33:16 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:16 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e0b28637-21e8-48bf-b1d8-106a2b1c833a" returned: 0 in 0.344s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:16 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e0b28637-21e8-48bf-b1d8-106a2b1c833a {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:16 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e0b28637-21e8-48bf-b1d8-106a2b1c833a Jul 14 21:33:16 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:17 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775/volume-e0b28637-21e8-48bf-b1d8-106a2b1c833a" returned: 0 in 0.232s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] Lock "cinder-quobyte-e0b28637-21e8-48bf-b1d8-106a2b1c833a" released by "delete_volume" :: held 0.617s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:33:17 devstack cinder-volume[88300]: DEBUG cinder.quota [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] Created reservations ['d1d14c1d-32b1-4d61-ba57-5c4acab16e8f', '2aa4f3a1-d43f-441a-9369-55e93a9bf532', 'f05c16c2-69b4-4430-8cf4-11af7e2dcb3c', '03c5a8fc-95bd-4b44-a671-392b564e107c'] {{(pid=88300) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 14 21:33:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:33:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:33:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:33:17 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:33:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:33:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:17 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:33:17 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:17 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:17 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.231s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:17 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:33:17 devstack cinder-volume[88300]: INFO cinder.volume.manager [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] Deleted volume successfully. Jul 14 21:33:17 devstack cinder-volume[88300]: DEBUG cinder.coordination [None req-690338bf-0fbb-4b16-aba1-9f51eb9846af tempest-ProjectReaderTests-971322714 None] Lock "cinder-e0b28637-21e8-48bf-b1d8-106a2b1c833a-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=88300) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 14 21:33:27 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=58,cinder:INSERT=21,cinder:UPDATE=88,cinder:DELETE=9 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:33:27 devstack cinder-volume[88300]: DEBUG dbcounter [-] [88300] Writing DB stats cinder:SELECT=63,cinder:INSERT=23,cinder:UPDATE=87,cinder:DELETE=6 {{(pid=88300) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 14 21:33:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:33:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 14 21:33:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 14 21:33:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8': None} {{(pid=88300) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 14 21:33:36 devstack cinder-volume[88300]: DEBUG cinder.volume.drivers.quobyte [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4d2b237-c222-45e1-953e-44f02eaf44f8'] {{(pid=88300) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 14 21:33:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.lockutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88300) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 14 21:33:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 14 21:33:36 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775 Jul 14 21:33:36 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 14 21:33:36 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Jul 14 21:33:36 devstack cinder-volume[88300]: DEBUG oslo_concurrency.processutils [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b41ac4dfbf4009a8d9c6adb23434c775" returned: 0 in 0.249s {{(pid=88300) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 14 21:33:36 devstack cinder-volume[88300]: DEBUG cinder.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Notifying Schedulers of capabilities ... {{(pid=88300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 14 21:33:36 devstack cinder-volume[88300]: DEBUG oslo_service.periodic_task [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] Running periodic task VolumeManager._thread_info {{(pid=88300) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 14 21:33:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread count: 28 {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 14 21:33:36 devstack cinder-volume[88300]: DEBUG cinder.volume.manager [None req-2d16b44c-fa69-4597-b059-f88575a064ca None None] thread info: [<_MainThread(MainThread, started 126597393186944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88300) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}